I'm not really familiar with early reggae, ska, dancehall and whatnot, but from what I've read 'My Boy Lollipop' was the song that introduced white man to ska.
Regarding Prince Buster, a fun fact is that Madness' ‘One Step Beyond’ is a cover of his song.