2
Experimenting with local LLMs on macOS (blog.6nok.org)
submitted 9 months ago by to c/Aii@programming.dev
4 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 9 months ago (1 child)

Wat I don't understand is how it's supported on Mac. Do they have NVIDIA cards? I thought everything was dominated by CUDA. Did the lock-in company implement CUDA?

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] [S] 2 points 9 months ago (1 child)

    Ollama uses the Metal API on Apple Silicon Macs for GPU acceleration.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •