47
ROCm on older generation AMD gpu (sh.itjust.works)
submitted 10 months ago by to c/selfhosted@lemmy.world
20 comments fedilink hide all child comments
 

I'm curious if anyone has had much luck leveraging older AMD hardware to use ROCm, I have an 6700 xt that I've just begun inquiring about, and it seems it falls outside of official support.

Right now I intend to pass it through to my Debian Docker VM to support transcoding in some containers in addition to machine learning applications.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 10 months ago (2 children)

mostly it is the hardware I have on hand; first project in mind is ROCm machine learning for immich. after that it's pretty much trying to understand the technology, I'm sure I'll come up with something fun.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 10 months ago (1 child)

    I don’t know how the immich ml works, but if you’re going LLMs stick to llama.cpp. 

    going beyond that, I’ve had serious kernel bugs with PyTorch and onnx that are still unresolved. The most popular ML/AI frameworks basically don’t work due to drivers for me. 

    Vulkan flows are fine and generally comparable in speed so far, so if there’s a vulkan option try rock first then revert to vulkan. 

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •