We use a clumping litter and haven't noticed a problem having it in the bathroom. We do have a good vent fan in there though, and use it with every shower to help prevent mold.
Our present cat treads much less litter than any previous. But that's because she doesn't bury anything, just steps delicately out and scratches the wall.