You can't always tell someone's ancestry from their appearance. Plenty of white/white-passing people, especially in the Americas, have recent black ancestors. Take this Appalachian community, for example.