Haha, that's definitely possible.
An alternative is that as he's always in front of the Union Jack... perhaps he simply has a "special personal assistant" dressed like this, who is always behind him in his home?
Keir: "Bring out the special personal assistant"
Servant: "But the special personal assistant's sleeping"
Keir: "Well, I guess you're gonna have to go wake him up now, won't you?"