But…if zombies don’t need to breathe, can they just walk under the sea to an island?

Sure. Some will absolutely end up there, but it would be far less than on the mainland.

one of the larger, immediate problems you face in a situation where you have infrastructure break down

I was thinking of the islands off of the coast where I live. Most of which are large enough to have small fresh water streams.