I'm sure that within those regions and communities, the use of that version of the sunwheel has a strong, long-standing association with Buddhism. Unfortunately the rest of the world did not, and most of us will instantly associate it with Nazi history. Some of us know about the Buddhist history of the symbol, but I'm not gonna be the one to wear a swastika and explain how it's not a Nazi symbol to every person that I see.
I know that the symbol has a historical meaning, and in Europe it was used as a sunwheel. I know that the Hammer and Sickle is a symbol of the working class. The problem is the propaganda against the Hammer and Sickle as a symbol of the people.
TLDR: propaganda and history has changed the meaning of these symbols to the view of the average person.