Reason might be that it weren't kids in the variant of the legend the painting is based on, but a kind of medieval travelling clerics on their way to Athens. Says so in the German Wikipedia.
Medieval paintings didn't care for realistic size comparisons, so might well have been misinterpreted as kids in later times.