34
How to selfhost a llm? (programming.dev)
submitted 2 years ago by to c/selfhosted@lemmy.world
8 comments fedilink hide all child comments
 

I'm trying to figure out how to host one myself. I'm trying to use barvarder and localai. But I am failing due to not enough knowledge and missing instructions. Any advice? did someone succeed with anything? I'd be happy to make other smaller steps at first as well. As long as I get somewhere.

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago

I haven't looked into specific apps, but I have been wanting to try various trained models and figured just self hosting jupyterhub and getting models from hugging face would be a quick and flexible way to do it

  • permalink
  • fedilink
  • source
    •