If your regular heating is electric anyway, then yes obviously.
Electrically heating a small space uses less energy than electrically heating a big space, that's fairly trivial.
How much less energy depends on how big your entire home is vs. the areas you'd heat with space heaters.
The most efficient solution would probably be IR heaters, as those heat you directly, as opposed to the air, meaning you can keep them off and let the room cool when you're not using it, and turn them on to make you feel warm almost immediate when entering a room, without the need to heat/keep warm the entire room, but that only works when you're staying in more or less the same spot for long periods of time, if you're moving around a lot an IR heater won't do much.