LLM’s are not the end all be all. What other AI tech are you all using? Something generative? Something else?

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 6 months ago (1 child)

All modern GPU drivers support Vulkan, at least on Linux. I don’t know how bad Vulkan does in comparison to CUDA, since I’ve never used that stuff. The bigger issue is software-side support. Ollama, llama-cpp and KoboldCPP all support Vulkan by now. ComfyUI doesn’t seem to support it.

  • source
  • parent
  • hideshow 1 child comment