It's actually my headcannon that the 3 wise men were 3 teenagers who accidentally time traveled. They blundered into the scene and felt bad and handed over 2 different scents of axe body spray and a handful of chuck E cheese tokens.

Given thier odd dress and incomprehensible language, they were assumed to be foreign and extremely wealthy. Not having any comprehension of the gifts they concluded they must be gold and exotic perfumes.