Honestly, I would guess you're one of a very small minority, yeah. Because phones get lost, stolen, or confiscated by fascist "law enforcement" pretty commonly. Or someone you know picks it up while you're gone.
Most people like a degree of privacy. Even my grandma has a pin on her phone.