I mean, they were white by our modern standards but if you read writing at the time, the Irish, Italians, Greeks, etc were often not referred to or considered to be white.

The Irish were also literally fleeing a genocide.