Its the heat, mostly. If you use the low or very low/delicate settings, it will help.

I find that there is no benefit from using medium or high heat. It just shrinks my clothes. Low/delicate doesn't and I haven't noticed any damage.

Other trick: wash and dry pants inside out to avoid fading. Also, this stuff only applies to fabrics that are dryer safe, obviously