Physical things exist, and will continue to exist. Energy is not created or destroyed, only converted.

Abstract things may come and go. Thoughts and ideas, understandings, etc...

Math and language are constructs we created to better understand and describe the world around us, and when the last human dies, so may all our amassed understandings.