All kinds. You should look at GPT4ALL at gpt4all.io. Its a gui for downloading and running LLM models locally. Its a great project. Of course, everything is local and private.
post
Registering an account is just a username, no password or email. (Generated API key is your password)
[deleted]
replies:
I use https://ollama.com which gives you a huge choice of models to run locally!
There is Lelapa, llamafile, GPT-NeoX-20B, BLOOM, Mixtrai8x7B come to mind which are not included at gpt4all.io.
replies:
one would think someone that calls himself THE MASTERMIND would know all... also LM Studio and no i'm not going to give you a link, your browser can do that for you
replies:
They are expensive to run. Why would someone pay the cost and offer it for you to use for free? When it appears free it’s most likely not free.
The word privacy based in your post probably explains it.
use ollama to run dolphin-mixtral locally on linux
Nextcloud can do it
all 18 comments