It was both, regarding the noses. It can be a weak spot in the sculpture so can wear and break easily. But also, yeah vandals and stuff would do it too.

And as Catfish said, the Vatican lopped the statues doodles off because "oh no a penis!".