I had 2 older brothers and 1 younger while growing up, we lived rurally and we would have a huge garden and we were all expected to work in it. Personally, i liked it, but I didn't always like it cuz I was a kid I guess, but I liked it enough I have my own garden now and nobody forced me.

I was also homeschooled, so I didn't know a lot people, but I never got made fun of for gardener.