The reality is much more complex that that.

And concerning population collapse, it's possible for a population to disappear if there's under a thousand isolated people. Disease, inbreeding, loss of crucial knowledge, climatic change, extreme weather, are all existential risks that a small population are exposed to.