You misunderstood what I meant, so I must have communicated badly.
I meant, people who often say "leave me alone" are "libertarian" types who want to benefit from society without contributing as they're able (with money or labor). Think of the kind of guy who says "leave me alone! I don't want to pay taxes for some school. I don't even have kids." They benefit from public education, but they don't see it that way, and they'd rather keep that 20% of their paycheck than have a fire department. I wouldn't call a baby a "freeloader" because they're not really capable of doing much. It's when people can contribute but selfishly and self-destructively choose not to that I'm scornful.
In other words, when someone says their politics are "leave me alone" I am very suspicious of their understanding of society. They want the privileges of society without the obligations, typically.