Yep. I bought two very expensive Logitech mice and they both began to get a sticky disgusting residue on my hands and fingers all the time, which I realized was leeching off the rubber itself.
I tried scrubbing them with rubbing alcohol and it didn't help. I don't use them much anymore and have decided to boycott the brand over it. You're only like the second person I've talked to who experienced this. I think most people just don't notice a lot of details. I cannot imagine we have unique compounds in our skin oil that break these mice down or something weird like that.