I'm quite prone to this. Even as I'm consciously resisting slipping into this fallacy, I can still feel that there is a pernicious and persistent kernel at my core that clings to the idea of a just world. For me, it is less about a moral kind of justice, more like a deep belief in some sense of underlying, teleological order to the world.
I know that this is silly, in every way that it is possible to know a thing. And yet, I can't seem to sway that deep down part of me that devoutly believes that actually, everything makes sense.