For images with large blocks of solid colors and no gradients, frequently the opposite is true. Screenshots and avatars with solid(transparent) backgrounds are often smaller as png.

It drives me nuts seeing things like tweets (white and black text) being shared with crazy jpeg artifacting. They'd be so much smaller and so much less ugly as png