You claim apathy, but you put more effort defending yourself then just being better toward you child.

I wont claim to know if it bothers your child to 'joke' about it. But have you ever asked?