But in the society we live in, that position is pretty extreme.
By what metric? And "Extreme" and "Extremist" are two different words, with different meanings and connotations.
Extreme simply means the far end of a spectrum. Extremist means
having or involving beliefs that most people think are unreasonable and unacceptable
(and that's even avoiding the legal definitions that exist in e.g. the UK that specifically tie "extremist" to violence)
At no point did I ever say that it’s a bad thing to hold that position
Without offering any metric by which to assert that, you most certainly did convey the commonly understood negative connotation by calling it extremist.