By "smart enough" you mean dumb enough to think racism only happens in very specific ways and something can't be racist against black people if it comes from a black person, no.
Your problem is that most people aren't "smart enough" because they're thinking too much, remember?