I didn't move to goal post at all. In any interaction, you need to gauge the vibe before moving to the next level. Workplace humour is sensitive, and you should drop a joke you're not confortable not landing.