Maybe an unpopular opinion, but he's not wrong, is he?
In lieu of gender-based leagues (a flawed concept in the first place), sports should probably be divided into physical weight/height classes in order to make sure that people of various builds have a fair shot and aren't going to be murdered in a big rugby tackle or whatever. That's not an unreasonable or anti-trans position to take.