See the thing is, he could live very comfortably as a hundred millionaire and help thousands of people with his excess income. Instead he hoards it. Is he actively evil like some other billionaires? No, but merely hoarding that much while others starve disqualifies him from "good person" status.
This criticism applies to every billionaire, not just Gaben.