The difference here that makes this comparison tenuous and potentially hurtful is that victims of bigotry are victims of structurally enforced power imbalances, AI itself IS a structurally enforced power imbalance.
Theoretically you are right in your point, but in practice you sound like asshole.