Like any pyramid scheme it's all fun and games until you run out of idiots at the bottom of the pyramid.

There's a famous anecdote from the 20s that some rich guy, Joseph Kennedy Sr or something, selling all his stocks after his shoe shine boy asks him about the stock market. Basically he realized that if shoe shine boys are investing, the stock market is running out of idiots and it's time to get out.