I have sweaty hands, so controllers get like this if I don't clean them. Difference is that I do clean them, it's not hard. And I wash my hands more often and thoroughly than the vast majority of people and this still happens. A tip for all buttons, especially the sticks, triggers and bumpers is to hold the controller with whatever you're cleaning pointing down so any possible buildup falls out instead of into the controller.