all 4 comments

sorted by: hot top controversial new old
[–] 1 point 1 year ago (3 children)

Wat I don't understand is how it's supported on Mac. Do they have NVIDIA cards? I thought everything was dominated by CUDA. Did the lock-in company implement CUDA?

  • source
  • hideshow 3 child comments
  • [–] [S] 2 points 1 year ago (2 children)

    Ollama uses the Metal API on Apple Silicon Macs for GPU acceleration.

  • source
  • parent
  • hideshow 2 child comments