Extramarital affairs are bad, but they're not the same as punishing someone for a joke you don't appreciate. And not responding to a text with a joke you didn't find funny is only dubiously that.
Infidelity can be abusive if used as a tool of power, control, or harm. Not all hurtful or disrespectful acts are intrinsically abusive.

I take it you weren't paying much attention during the whole thing?

https://slate.com/news-and-politics/2009/11/why-tiger-s-not-talking-about-his-accident.html

Tldr: initial reports indicated that she hit his car and attacked him with a golf club before the crash. Police stated alcohol didn't play a role in the crash. He denied any claims of domestic violence and says she smashed both of his back windows to help him out of the car.