You already admitted that I'm right, you just haven't realized it yet.
The N word doesn't literally mean people with skin that is black. It means people with dark skin of African descent which is a much wider scope.
You put quotes around black. The word is a reference to a larger group, just like "boomer" is a reference to a group larger than people born between 1946-1964.
Boomer was derived from the term baby boomer, but they don't share a definition.