I've seen cloverpatches in the wild with a variety that produces almost exclusively 4 leaved ones. They look a little different than your average clovers but you might have seen those! Either way childhood memories are fickle.

In my childhood we'd hunt 4 leaf clovers for days, only found a handful of them and never seen one with 5 leafs!

The leaves do sometimes split apart in the middle so you have to make sure they're not 2 leaves and 2 halves.