Because for privileged people it is just "oh ha ha, that person is an asshole"

For a lot of folk? It is a sign that someone actively wants you dead or enslaved and doesn't care who knows it.

Or, in this case, it shows that they care so little about the actual victims that they think it is Ironic to wear a nazi uniform around so long as they flip the skulls upside down.