Yeah it's not so much that rape was not considered wrong, but that they had different conceptions of consent than we do now.

When you drive a vehicle, in most states, you consent automatically to having your blood taken by police officers. In most states, you can literally have your blood taken from you against your will. But because you agreed to have a driver's license, according to most states, you've legally consented to this violation of your body.

Rape is obviously a whole different level of violation, but marital rape historically worked the exact same way we treat drunk driving blood draws today. When a woman was married, legally she was consenting to any future sexual activity her husband desired. She couldn't withdraw her consent after. Her consent was implied through the act of marriage.