You can take them outside, but they should be leashed.
And I don't know why you're making a demand like that. Why is your attitude like this?
If your usual reaction to finding out you're doing something wrong is to demand a stranger change drastic things about your life to resolve a problem you're causing, then it's harder to have sympathy for the situation you described in your original post here given that we only have one side of the story.