I've been going to a karaoke bar every Saturday since the year started . I can't recommend it enough.
A good karaoke bar is a great time. You don't have to sing if you don't want to. And if you do sing, it doesn't matter if you suck or can't sing or stumble your words or forget some lyrics. Going up there and singing is an accomplishment in itself and no one at the bar is going to boo you or kick you off the stage. Worst thing that happens is you get no applause at the end but a good bar with a good vibe will always have people cheering you on.
Going regularly and getting up there and singing and not caring if I suck has done so much to improve my confidence and self esteem. And trust me, I suck at singing but I promise you that it doesn't matter. No one will care that you suck. If you go up to sing, just go and have fun with it.