Im using Ollama on my server with the WebUI. It has no GPU so its not quick to reply but not too slow either.

Im thinking about removing the VM as i just dont use it, are there any good uses or integrations into other apps that might convince me to keep it?

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago*

But they run locally on the phone, if I'm not completely mistaken. So no use for a server.

Or do they offer this option? I think they explicitly advertise no internet access.

  • source
  • parent