Not at all. Our air is made up of physical objects (molecules of oxygen and nitrogen, mostly). Things with more mass, more quickly knock those out of the way.
For a demonstration you can see and more easily wrap your head around, take something just barely heavier than water, and a similarly sized heavy rock and drop them in a pool. You'll see how much quicker the rock gets to the bottom, because it displaces the water so much faster. Our atmosphere is the exact same.