You break into a house, you have nefarious intentions. You made a choice to cause physical harm, you pay the price. The victim didn't choose to be broken into, with a weapon to be used against them. The victim doesn't know if that weapon is for intimidation or action.
See, this is the problem, victim is held responsible then bleeding hearts feel bad for the aggressor when he gets what's coming to them. In the moment, you don't have hours to reflect on your actions and adrenaline is one HELL of a drug but yes, keep protecting the aggressors, when they do serve a small amount of time the bleeding hearts try to get them released even when the victims fear their release