The thing is, this isn't like the first time he's agreed, sympathized, or shown support for nazis or nazi ideas.
He bought twitter and it now shows far right sentiments considerably more often.
He often retweets or show support for far-right extremist ideals on that website now.
He has always supported and continues to support white replacement conspiracy theories. These are often arguments used to push nazi ideals.
The list goes on. Whe someone say the kind of BS you reference in your post I think it's important to not let them move the goalposts to an argument about a one time event. Elon Musk giving a Nazi salute was the most recent and most publicly visible in a long line of Nazi sympathizing and pushing Nazi ideals.