A bit of a buffer battery is good.
I've got the opposite problem of lithium batteries freezing. But three NiMH batteries in series is close enoigh to drop-in. They're ok with cold, maybe also heat?
Or, capacitor to even out the load. Or a super-capacitor if you want to last all night long. They'll consume everything to charge up from empty, though.