We as a species could have arranged any kind of leisure society when we started using fossil fuels. The energy bonanza that allowed us to reach 8 billion people with chemically-boosted and machine-harvested food allows it.
Of course, this means a flattening of the lifestyle, no more McMansions but also no more squalor.