The issue is if you choose to have kids, and that's already assuming there was a choice which is not always the case. You can never get that time back. You must care for a child, if you do not that's prison time. Even meeting the bare legal standards wouldn't be moral, meaning you must give up more time.
If I decide not to do my hobby one weekend and binge Netflix instead that's fine. It is my free time and there are no consequences in changing how I spend it. Caring for a child is an obligation.
I wish we lived in a society where every child was wanted and brought into this world by people fully prepared and understanding of the time commitments necessary to raise a child. Unfortunately that is not the world we live in