A lot of people don't realize how much of a lifestyle change and commitment it takes to even begin to look kind of like a bodybuilder. A lot of genuinely smart people think going to the gym twice a week would give them more muscle than they know what to do with. Yeah it's stupid, but it's a common misconception.

Edit: here's a post I found about it: https://www.girlsgonestrong.com/blog/articles/big-and-bulky/ it's about women, who worry about this a lot more than men, but I'll bet a lot of it applies to both genders.