Biological sex is a large cluster of traits with bimodal distributions where typically the traits are somewhat close to each other on their curves.

You still manage to get situations like my ex's mom getting karotyped as XY despite having given birth multiple times