What's wrong with that? My first cat was allowed in and out whenever he wanted. It's not a flawless system but it has some merits. Why should a cat be locked up like a prisoner?
It's like the old saying: if you love someone, set them free. If they come back, they're yours.
That said, our current cat does stay home 24/7. This was a conscious decision before we got her (less worries, less fleas), but she turns out to be such a scaredy-cat that she would never leave the house even if given the choice. I've tried to let her a few times as an experiment. Even when we just have some guests over - whom she has already met, and who come regularly enough - she still hides under the bed.
Basically it depends on the cat. Some cats live their best lives when allowed both indoors and outdoors.