The problems don't come from explicit racist language or something overt like that. It can be as simple as a trained model settling into correlations that we don't expect, and reinforcing biases in that way.

Like you give it positively scoring prior hires, who all happen to be in men's sports leagues during college. The model picks that up and scores new resumes with men's leagues participation higher.