Irfanview has been my image viewer on Windows for years now. You can install the full plugin pack from the main website (button below the main installer download) and you'll be set for just about anything that identifies as an image.
(edit) It's not FOSS though, but it is free.