Or, they used to recognize him from a distance. The moustache changed his look enough that he was able to get closer before they fled.