you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 1 year ago

llama and pytorch support it right now. CUDA isn't available on its own as far as I can tell. I'd like to try one out but the bandwidth seems to be ass. About 25% as fast as a 3090. It's a really good start for them though.

  • source
  • parent