For people not following, he was saying that if he was the corrupter of youths and weak-minded men, then everyone else must be improvers. Because not everyone else are improvers (logically speaking in this argument), it means many people were responsible for the corruption and he alone is not responsible.