It's worth noting that the OED, though it claims to be a world English dictionary, is still pretty biased towards British English.
In this instance it appears fine and even pretty helpful, though. The definition of "small handbill or fly-sheet" appears to be limited to the US, and most of the citations use the "flyer" spelling, which supports the claim that it's more common but that both are acceptable.