That's probably UV degradation, Most white paint is made from Titanium Dioxide, while most blacks use more stable elements.

UV radiation can eat trough the binding element in paints and leave the titanium dioxide around as a dust.

Source: I remember going down some internet rabbi thole years ago, someone please correct me if I'm stupid.