If you want to make the point that the physiological advantages men have in sport are rarely, if ever, disadvantages, that’s a reasonable observation. I’m not sure, however, how that might somehow invalidate anything I’ve said or any argument I’ve made.
Being only 5ft tall would be a disadvantage in many sports — Tennis, for example. The fact that it isn’t a disadvantage in all sports, does not stop it being a disadvantage in Tennis. Consequently it seems unfair to make special provision for people who are disadvantaged by not being a man, whilst not also making special provision for people who are disadvantaged by not being tall.
You could argue that it’s not too bad for the short man, because he could take up some other sport instead. But perhaps he particularly wants to play tennis.
At the end of the day, I don’t see anything fundamentally wrong with people simply playing sport with other people of similar ability, regardless of gender. And whilst you may take a different stance, I don’t think you have successfully argued that there is anything fundamentally ‘flawed’ with the stance that I take.