You don't have to rake it away, just make it irrelevant. They only have so much power now because First Past the Post voting systems don't need anywhere near a majority, just a little more than everyone else. So with as few as 3 candidates you could win with only 34% of the vote.

Switching to an actually representative election style like ranked choice voting means the outliers are represented more accurately instead of getting an oversized platform their size doesn't warrant.