That's true and it's kind of bad to have them where you're walking daily. That's when I would do something as well.

I already said that in my first comment.

Theyre an important part of the ecosystem though. Pest killer number one. If there's constantly wasps settling near you, there's a reason.