Not every sport is as unrelenting and physically demanding as an athletic event like swimming or hockey, but on average, collegiate and pro athletes have to have a fairly high level of natural talent as well as a commitment to be prepared for the competition.
Grueling gym routines, intense physical rehabilitation after an injury and specially planned diets are simply a greater part of an average athlete's life than these things are for everyone else.