Because your religion never stops at you. History has shown that every chance it can, religion will try to control peoples lives.
It’s like being anti-capitalist. Wanting a revolution would infringe your freedom to choose to exist in a capitalist society, but everyone else would be better off for it.