This question deserves better reaponses. If you can't or don't want to self host, Tidal and Qobuz are probably the best alternatives. Tidal doesn't do podcasts though so if you need to replace that as well, take a look at Antenna pod which as a bonus is available on F-Droid.

If you mean another streaming service and not just hosting music yourself like others are suggesting, I’ve heard good things about Quboz.

MP3s and FLAC. The only thing the services offer that's even remotely useful is finding new music that I might like but.... gasp I was doing that before the internet, too.

Tidal. It's okay but the windows desktop app is buggy. Keeps playing a different track than it shows on the UI. Search isn't great. Android app lacks voice input support.

I set up a Plex server with all my old media, I downloaded my old music collection from my google data (if you ever had your own files stored in Google Play back when it wasn’t just a store but also a media player, it’s still downloadable from Google). I use the plex amp app, it looks like a Spotify skin but works with my personal collection. It’s been pretty great, I run it off an old beat up gaming laptop and 20tb USB drive.

I've been happy with Tidal. Their library is extensive, you get better sound quality and it's cheaper than Spotify. No podcasts or audiobooks but I use different services for those anyway.

I have been self hosting since 2008. Went through around 7 different apps since then, and I am currently using Navidrome, which is a fork of Subsonic with the android phone app Symfonium. For a while there self hosting looked pretty bleak around 2020, but it seems to have found a resurgence which I love because the development has been big again leading to more modern looking players and a lot of great new functionality.

I have gone with a combination of buying/downloading music that I really enjoy and using Qobuz. The quality of music is great, but the selection and discovery just aren't as good as Spotify.