That is not even close to the second most famous symbol and the vast majority of people would not know it was a Nazi symbol.

You can argue that's an education issue if you want, but it's simply not one most people would recognize.