you are viewing a single comment's thread
view the rest of the comments
[–] 8 points 1 year ago (2 children)

Am curious if NPUS can be used in Ollama or Local LLMS,if it can't then its completely useless also useless if you don't use AI at all.

  • source
  • hideshow 2 child comments
  • [–] 5 points 1 year ago (1 child)

    This might partially answer your question: https://github.com/ollama/ollama/issues/5186.

    It looks like the answer is, it depends on what you want to run as some configs are partially supported but there's no clear cut support yet?

  • source
  • parent
  • hideshow 1 child comment