We get it. You chose not to pull the lever.

You can try to ease your conscience by saying that at some vague point in the future you can destroy the trolley entirely, but that is the future. The trolley problem already occurred. It already went past the switch, there's no going back and changing that. You chose not to pull it, you have to live with that.