What's a "strix board"? Is that necessary?
comments
Not imatrix or advanced quants, but yes.
But there are more then enough stock models for this task I would say. For specialized use cases though costum quant can be very very powerful
Did anyone mention that huggingface will quanticize for you? Its like one button push.
Besides marketing slides and claims of people profiting from hosted models, you do not need a 1Trillion parameter model
Openrouter is also nice for this. You can use real cheap models for embedding and the bigger ones for the actual research.
Yup. And if you want to take a small step without major hardware requirements: connect your setup to a paid subscription Mistral or Anthropic API. They allow you to switch off training on your data.
On top of that, the costs are way lower than the normal consumer grade chat subscriptions, and your searches + memory are kept locally (e.g., managed through open webui).
Great man! Gentoo lover and long time addicted here.... Keep it the good work!
If you have the equipment and about 5TB of storage Fable 5 AI is available by Torrent on Pirate Bay right now. :)
THis is great, thanks. I'm on the z-13 and needed to use it for a work project, which is wrapping up soon. I'm planning on re-building it as a locally hosted agent support machine.
"Hey Claude, research for me current research to Nuclear Fusion. What are the biggest hurdles what are the next steps, and how promising is private research" enabling the research feature will give you a report, Fact checked (not clean but ok ish), and all the sources for it.
Claude will spin up a bunch of workers and search the web, following leads, and so on.
One of the few actual useful features of AI IMHO
I am on Gentoo for it, but everything with a decent rocm should work.
Have a look for llama-swap, that handles multi head endpoints.
Also, as you are on a big board, you can quantize yourself, as the BF16 version of qwen has only 72gb.
I will try and post a full writeup next days. But feel free to dm me, if you need some guidance on quantize or more.
I am using this fork currently: https://github.com/charlie12345/ROCmFPX
Stuff happens fast currently, so may be worth to wait a week or two ig you need something super stable, but if you are up for experimenting, that's the way to go
Do you have a walk through for setup?
I'm on the strix halo 128 gb variant and while I got ollama working fine, i haven't gotten any of these multi headed setups working
What's an example of something you can do with this? I'm not familiar with Claude
For those who want to know more, rough setup:
- llama-cpp rocmfp4 fork
- currently custom quantized qwen3.6 35B A3B model, working on publishing
- be3 embedding and reranker, also GPU
- gemma4-e4b via FastFlowLM on NPU!
- OpenWebUI and searxng as docker containers on a Pi currently
We get 70-100tok/s generation. Four slots with 256k context length each.
We use a smaller Board with "only" 64GB of shared LPDDR5X. Bottleneck is memory speed, rocmfp4 quants help a lot.
As soon as I get my imatrix calibration right, I will publish the quantized versions.
Most existing quantized models are broken. The authors did some not supported stuff (like using a already quantized model and requantize it) that you may get issues with coherence or sudden Chinese words in the output.
That is not an issue with rocmfp4 but with vibe coders and agent psychosis.
Openwebui+searxng on a AMD strix board.
Pro: works like a charm, low power consumption, fast, "big" , LLM (running qwen3.6 35B A3B + gemma4 E4B for website summaries and other smaller tasks)
Con: strix boards start at 2k€, more in USA because of tarrifs
Audiobookshelf is top tier. Probably my most used service that I host. Pair that with https://libro.fm/
Navidrome user here as well. I use feishen as my Linux and windows desktop client. Big fan of both.
As others have said, api is just the standard, so it gives you a lot of options
Currently im using Namida which is also great and open-source in contrary to Symfonium.
Namida supports Local music, Subsonic and Navidrome servers, WebDAV and even YT music if you even need a song that isn't in your collection yet.

Another alternative (proprietary) is Symfonium
Yep. Dsub is pretty much in feature-complete, maintenance-mode, that is years out of date and hasn't even updated to material 3 UI's which the others have.
I check the others every few months or so, but they're all still either buggy or missing so many features compared to dsub, that I have to switch back.
Preface: This is what I learnt about Subsonic and such. The informations below may not be fully correct but the core idea is there.
An API is not a piece of software.
It is merely a way to define how to make a software "do" an action, like search for a song title or download the song file for streaming/playback.
Navidrome does not make use of anything from Subsonic, it merely implements (exposes) a Subsonic-compatible API.
Knowing this information, anyone can run a web request to Navidrome and search for a song, and download/stream it, like they would already do for any other Subsonic-compatible provider:
You can find a plethora of software that can leverage any Subsonic-compatible API provider to connect to that music library, from dedicated Web UIs to Android and iOS apps, which know how to download and stream songs and play them back.
This mechanism gives the user the freedom to choose the backend and frontend, and the developers can just implement the part they prefer: for example, the Navidrome team does not have to build an Android or iOS App, whereas App developers don't need to write a serverside application to manage the "real" music archive, decode tags, or even implement a search algorithm, as all this data can be asked via the API.
Technically, Navidrome wouldn't even need a Web UI.
Over the years, the Subsonic API has been forked into OpenSubsonic API, which as far as I could tell, merely serves as a way to better define, and to further add new features into, an otherwise closed and possibly reverse-engineered API.
Totally agree with you! It's not flashy or modern looking, but everything is where it should be and it all just works exactly as I want it to. I keep others installed on my phone to just to look at if an update improves them, but nothing has yet. Currently installed are ultrasonic, tempo and substream. Non are as good, but all looks better than dsub2000.
I use Tempus on my phone for our Navidrome server. You can download your music to be available offline, I use it a lot.
Edit: On their repo it says they have podcast support but I never used it so I don't know how well it works.
No. If you only listen with one device tho, no problem. Then just mark it finished it audiobookshelf when you're done.
As far as I can tell, Voice doesn't integrate with anything. You pick a device folder where the audiobook files are, and it's all local.
Anyone who might know better, feel free to correct me.
I dont know what the landscape was like more then 2 years ago, which is when I got in to this, but dsub2000 honestly looks like the worst option I've come across.