But isn't the problem rather that people can be easily convinced to vote against their self-interest? It seems the people at large are not selfish enough, and the rich are too selfish?

In other words, the problem is that those that don't have, don't want to have strongly enough, and those that already have, want to have too much. As an overarching group, not individually, of course.