Yes.

Basically if you leave Alkaline batteries in the device for a long time (years) without using them they will loose all charge and there is a chance of them leaking.

Leakage is significantly more common with the Zinc-Carbon batteries (the tech in use for most batteries in that format before Alkaline) though those leak something that forms blueish crystals.