7
What's the next gen AI tech you're using or experimenting with? (lemmy.world)
submitted 6 months ago by to c/fosai@lemmy.world
24 comments fedilink hide all child comments
 

LLM’s are not the end all be all. What other AI tech are you all using? Something generative? Something else?

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 6 months ago (2 children)

Thanks! I’ll make sure to include Vulcan in criteria for a new machine and I’ll look at intel options. Only been looking at NVIDIA. Even 4GB VRAM will be a huge upgrade for me.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 6 months ago (1 child)

    All modern GPU drivers support Vulkan, at least on Linux. I don’t know how bad Vulkan does in comparison to CUDA, since I’ve never used that stuff. The bigger issue is software-side support. Ollama, llama-cpp and KoboldCPP all support Vulkan by now. ComfyUI doesn’t seem to support it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •