I guess it also depends on your definition of "leave Earth". If you're in orbit, you're still kind of tethered to Earth. Quickest way to leave the gravity well is straight up, although escape velocity in most directions will get you there.