you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 1 week ago

So far I've been using a wrapper for wrappers called ramalama which makes opinionated choices based on your hardware. My main machine is a 64 core Arm machine with an 8gb AMD card using Vulkan. I'm sure I could do better but it's a lot of tweaking I don't have time to learn about right now.

  • source