Mindustry really had me hooked for some time. The devs call it an "automation tower defense RTS". GPL-3.
Thanks for your reply. A practical follow up: do you mount storage from the host or do you use virtual drives?
I use ZFS on my host and and file recovery is just so convenient when the services can write directly to it. I'm reluctant to give that up but assume a mount reduces isolation.
Title made me suspicious already.
As an alternative to mounting full /dev/dri, there are symlinks under /dev/dri/by-path/ which you can use. IIUC they are linked by the used PCI slot, hence should be as stable as the physical order of the cards.
I use this pattern in a compose file:
...
devices:
- source: /dev/dri/by-path/pci-XXX-render
target: /dev/dri/renderD128
permissions: rwm
In case you are unaware, friends don't let friends use ollama. The llama.cpp CLI has become pretty much equally easy to use, plus since you use Docker there's no need to compile anything.
Edit: typos and missing words
Haha, that sounds like procrastination to me.
Not necessarly, I'd say. We've seen many releases with multiple sizes and the 27B class has been around since at least the Gemma3 times.
I hope an instruction tuned will be released as well.
I find the overall parameter size interesting. On 16GB VRAM the whole thing fits at an excellent quantisation without having to offload anything to system RAM and taking hits on PP & TG.
According to the officially reported benchmarks, Ling wins on GPQA Diamond (73.4 vs. 64.6) and BFCLv4 (62.72 vs. 62.3). No other overlaps.
That being said, I'm neither trusting benchmarks alone nor have tested any of the two extensively enough to have a solid impression.
I totally get your point but it really depends on what scope you define. For me, coming from Gnome and not feeling like constructing the whole shell aspect of my desktop myself, these tools do that job very well.
Also Noctalia v5, it's a joy to use!
There is the Swiss project Apertus AI, and I think I've read about others but don't remember the names.
That being said, if the benchmarks translate to real utility, it is the first competitive open source model, I'd say.
The service starts as it should, right? The errors appear only on request, right? Any other sections in the compose logs that seem relevant?
You use podman-compose with the Podman backend?
And there are no volumes mounted, just to be sure?
No expert but don't the logs look like the requests are coming through?
I guess some people consider it cool. I'm not one of them.
Yeah right? At least a layer of VPN on top.