You don't abide by any kind of government. You can't. Your will cannot align to be violated. This is why you believe the purpose of voting is for, so when one person does something with your money that you don't agree with, you believe you can get another person who won't do those things.
I would argue that it isn't that you're in favor of government, it's that you're in favor of a justice system, school for your kids, roads, and other infrastructure. But to say you need the system of coercion we have in place else we can't have those things is just nonsense. Would you not pay to have security if the government didn't do police? Is your argument that other people wouldn't? Who are these "barbarians" who wouldn't? Do you know them? I don't. I don't surround myself with people like that, so it always diverts back to this idea that it's the "others", the "outsiders", the "barbarians" who wouldn't do this stuff if not coersed. Never us.
And even if you wanted to argue that you wouldn't want to pay for police then you're just arguing for less government, aren't you? If you wouldn't pay for police unless forced, then you don't want police that badly. This isn't a difficult concept. If I want something, I go and buy it. If I don't buy it, I didn't want it that badly. I fundamentally decided that I value my money more than the good or service itself, so I didn't make the trade.
I simply take it one step further and understand that you shouldn't be able to take my money to do anything with that I don't agree with. If I agreed to it I would give you the money without the coercion. When I want something, I buy it from the store. When I don't want something, you have to take money from me to get it if you won't buy it yourself.
There is no such thing as governments, mind you. There are only people. If your neighbor were to come to your home and tell you they want $500 to do something with and you disagreed and they returned with a weapon and threatened you unless you gave it to them, you would immediately admit that such a scenario would be both immoral and crazy. The thing is, the propaganda you've been raised with is duping you into believing that this isn't exactly what's going on because they slapped a badge on your neighbor and convinced you that it's not theft and authoritarianism.
If your neighbor made a nice looking badge and pinned it to their lapel, would that make it official? What if 10 of your neighbors all agreed that it was official and legit? Does it make it official and legit? What about 20 neighbors? What about 50? 500?
If not 1, then not 1 billion. No number of people agreeing to something warrants that it is legitimate. It used to be that millions of people agreed in slavery and slavery has never been legitimate. It was thought by many as legitimate, but so what?
There isn't anything wrong with government if that government isn't robbing you - that's the rub. All a government really is is a relative force monopoly. If the government vanished tomorrow and your neighbors all gathered together with you and agreed to help one another and protect each other from outsiders who might seek to do harm to you or your properties, you would be a government, albeit a small one.
And I'm not saying we could or even should do away with current governments in the world tomorrow - even if we could. We would need 50-100 years or more to slowly wittle away these systems so that free people can take their place.
So to answer your question specifically, I don't think it has anything to do with anarchists and everything to do with logic. If it is not OK for your neighbor John to do to you what I outlined above, then it isn't OK for Tom to do it if Tom is a representative of the "government". There is no such thing as saying you can rape someone because a group of people got together and decided what you decide is right is legitimate and therefore, it isn't even rape.
The mere fact that your neighbor doing what the government does would be even legally classified as theft but when the government does it it's not called by that same word should be a gargantuan red flag. Only the politicians and political manipulate language in that way. The honest of us just call it what it actually is - theft.
If I own something and you want it and I do not want to give it to you and you take it, that is theft. It doesn't matter who does it or what "group" they are affiliated to. You don't get to steal and then try and say it isn't theft because your version is "legitimate".