If you didn't directly cause some sort of impact or bend that would have resulted in separation like this, then yes, most likely the battery is toast. You should stop charging and using it entirely.

I've seen Samsungs like this and it was just the glue on the slightly stressed back cover being bad.