I think conflating racists and slave owners is a bit disingenuous. The slave owners would have done the same thing to white people if there weren't any convenient Africans to exploit.

They weren't racist, they're were just incredibly lazy and selfish, and also possibly racist but in a disconnected way.