Sometimes I leave it, if the comment is general enough that maybe people won't notice. Or I'll edit the comment to make more sense.

The fun ones is when I comment on the wrong post, like I click the post above or below and make my comment.