There is a tragically high recidivism rate for sexual predators, which is probably the best argument for long sentences: there aren't many opportunities to abuse children in prison.
Though the American rehabilitation system is pretty weak in general, other nations have had much better results. Norway has a sex crime recidivism rate below 10% (vs 67% in the US).