Quoting THE GOD EMPEROR OF MANKIND:
"Guys im not a god, just a man"

I'll go and see whos knocking on my door now.

Though joking aside, yeah that was the issue. He was just human. Powerful one, but still a human.