How does anyone "belong" to a sex at conception? The only interpretation I can give to this is chromosome gender. But then what about people with a faulty SRY gene who are XY but are born female?
The "only 2 sexes" idea just sets up two procrustean beds: you have to fit in one or the other, and anything that doesn't fit gets cut off.