We were meant to be rugged individuals, but rugged individuals living in a community with other rugged individuals.

Also, farming has always been a hard job. People who garden are doing the kinds of farming that farmers did before automation became a thing, but they're doing it on a tiny scale. One farmer using non-industrial methods is going to have to really work like a mule to keep just themselves and their family alive. So, gardening using those same methods is never going to produce enough calories and nutrients for anything meaningful.