I don’t consider man’s work to be just physical labor.

The key here is that the English language currently does a piss-poor job of creating a destinction between meaningfull, avocational, enriching "work", and meaningless, necessity-driven "labour." Anthropologists have found pre-agrarian cultures tended to do far less labour, but had plenty of activity. I blame pretestant "work ethic" for equating taking out the trash and all that with meaningful work that makes a person.