Yeah, the rules for casual sports and kids' competitions (up to a point, anyway) should be different from professional-level athletes. The discussion should be different also.
For casual sports, the primary issues are, probably, (1) can we make everyone feel sufficiently comfortable and (2) is everyone sufficiently safe.
These could have very different answers from "does trans identity provide a larger potential boost than banned performance-enhancing drugs" which is one primary fairness issue in professional sports.