That's how it feels, sure. But you can't properly control what other people do. You can control what you do.
In situations where you've been fucked over, you can't force the other person to feel guilty, try to make amends or seek your forgiveness. That would be great, but you can't make it happen. All you can do is move on from it, which means forgiving them. If you hold a grudge, that's mental effort, time and energy that you're continuing to spend on them, because of the shit that they did. If you can forgive them, not only does it make you a better person, it also removes the control they have over you. It's not exactly satisfying, but ask yourself what would be. The past isn't going to change, and that asshole isn't going to suddenly grow a conscience. Don't let their actions ruin who you are by getting consumed with bitter feelings!
I know this is kind of general, and some things are a lot harder to forgive than others, but I find it's amazing how much easier it gets as time passes. I've been treated horrendously over the years and I refuse to hold a grudge. I've shaken hands and made jokes with past abusers, which is probably the biggest "fuck you" I could give them. They know what they did; I'm still happy and functioning. They have no power over me, and I certainly will never let them close enough to do that again.
I know this is all a bit unsolicited on my part here, but I just recognised what you wrote as something I've felt too, and I would've liked someone to tell me this when I was. I'm not trying to preach.