If you wanna double down in the worst way possible say, "somebody's grumpy this morning!"

Generally I find the best thing to do is to sort of snicker at your own joke to make it clear it was just a little joke then don't say anything else if they didn't react well.