https://github.com/marytts/marytts
I've used MaryTTS semi-recently. It's older but works well enough for my cases. I have it running on a server (locally) and my endpoints make a call to it and playback the returned audio file.
On Android, I use SherpaTTS which has good voices, but I'm not aware of a desktop/Linux option. It mentions using voices from Coqui which you linked, so I would guess that would be the way to go for desktop.
Piper just moved to https://github.com/OHF-Voice/piper1-gpl
It's fine, and it's probably the best TTS you're going to run locally.
Kokoro is your best bet right now. It works wonderfully even in a docker container with no GPU. There are others but I don’t have the list right now. Will throw another update on here when I do.
The rhasspy guy was very invested in Coqui. He built a lot of his own stuff, for his home automation and such. But Coqui was superior, so he started spending time on that.
Unfortunately, the coqui team (based out of Mozilla) was very distracted and didn’t ship a lot of stuff on time or at all. It doesn’t even have basic stuff like SSML support right now, if I recall correctly. So the rhasspy guy also lost steam.
Of course, with the OpenAI model of audio generation, you’re expected to not use SSML at all and just use the black box API to get “good enough” results. That really sucks.
Oh, I just remembered which other one I wanted to mention - someone has built an open source version of NotebookLLM, complete with multi voice support. But it requires GPU, I believe. Do what you will with that. I’ll add a link if I find it.
I prefer kokoro because it’s really solid and works really well on CPU.
Tbh I generally prefer that robot voices actually sound like robots. I don't want human sounding TTS since I don't like anthropomorphized machines. So I'd stay with something low tech.
Check the README for piper. It moved to https://github.com/OHF-Voice/piper1-gpl
Here is the repo for the piper I use, https://github.com/OHF-Voice/piper1-gpl
For my phone, I use this tts engine, https://k2-fsa.github.io/sherpa/onnx/tts/apk-engine.html
https://github.com/resemble-ai/chatterbox is pretty good, and has both TTS and voice cloning. Main disadvantage for me was that even if the cloning gives a consistent voice, the generated samples can get random accents.
https://huggingface.co/zai-org/GLM-TTS also seemed pretty promising, but I haven't had time to test it yet.
Save that post for the next time when someone with too much time on their hands asks what project they should start/contribute to.
Try alltalk_tts v2. One of the features is you can provide an audio sample and the AI will imitate the voice. The overall quality is pretty good, if you choose a larger model and let it run.
It really depends on what you want to do with it. I run wyoming-piper as part of my Home Assistant deployment and its been rock solid. The Wyoming protocol is pretty well documented too, so you should be able to integrate with it pretty easily.
I highly recommend Mlx-audio for anyone doing tts on Apple Silicon. It offers great performance, leverages kokoro-82M, and plays well with streaming frontends like Open webui. The one shot voice cloning feature is also pretty cool.
Faster Whisper could be a option, there is various GUI options available as well.
https://github.com/SYSTRAN/faster-whisper
And if you are looking for something that you can "just install", I recommend balabolka. The voices are natural and you can use some of the windows built in voices to make it more natural.
https://www.cross-plus-a.com/balabolka.htm
Make Azure natural TTS voices accessible to any SAPI 5-compatible application.
Not sure what you're asking here, but are you talking about the voice part, the TTS pat, or the interaction?
all 32 comments