What's a large number of people? 10,000? 10,000,000? Amazon Prime has 180 million subscribers in the US alone, with a revenue of $44 billion dollars annually.
That represents less than 7% of Amazon's annual revenue.
You cannot fathom how massive Amazon is, and how small consumers are in comparison. By all means, stop shopping on Amazon. We all should, because we can. Just don't expect Bezos to give a shit.