you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 1 year ago

I tried running some models on an Intel 155h NPU and the performance is actually worse than using the CPU directly for inference. However, it wins on power consumption front IIRC.

  • source
  • parent