codeinabox comments on Experimenting with local LLMs on macOS

submitted 9 months ago by codeinabox@programming.dev to c/Aii@programming.dev

4 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] codeinabox@programming.dev [S] 2 points 9 months ago (1 child)

Ollama uses the Metal API on Apple Silicon Macs for GPU acceleration.

parent

[–] onlinepersona@programming.dev 1 point 9 months ago (1 child)

Interesting. Is that similar to Vulkan?

parent

[–] codeinabox@programming.dev [S] 3 points 9 months ago

Vulkan?

I'm not too familiar with either, but this article goes into more detail: A Comparison of Modern Graphics APIs

parent

lemmy:	0.19.20
mlmym (mschae):	26.3.4