It's fuel that's the problem. To carry enough fuel to get anywhere significant would weigh you down too much. Plus, imagine how stupid people already are when they drive, now imagine them being able to fly anywhere, anytime. It'd be a disaster.