1/4 of Presidents lived in a time and society where owning slaves was accepted.
Abolitionism is as old as (edit: chattel) slavery itself. They owned those slaves and inflicted unspeakable horrors on them despite no shortage of people telling them that's wrong; it's not like "black people are people too" was such a foreign thought to them.