Eh. It is a popular meme but I think even with the info the movie gives it is pretty clear why. They need to go in secret and Sauron and Saruman have spies/scouts about (like the Sarumans birds).

And even if they flew to near Mordor undetected, the giant freaking Eye would spot them - if the patroling Nazgul wouldn't spot them first.