1
Idea: Selfhosted Interface for LLMs (lemmy.blahaj.zone)
submitted 1 year ago* (last edited 1 year ago) by to c/foss@beehaw.org
2 comments fedilink hide all child comments
 

Like SearchXNG but for chatbots.

Acts as a trusted inbetween that takes the hit on all the tracking for you and you need no account.

There would be a self-hosted server with a webinterface, where you can choose which of the popular chatbots or hosted open source models you want to ask.

The not free Accounts could be payed with donations maybe?

Basically like duck.ai but without a big company involved.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 year ago

This is already a thing, there are a myriad of LLM chat interfaces where you can either connecting to models you are locally running or connect to APIs of providers. "Open WebUI", "librechat" and "Big-AGI" are web interfaces. On desktop you have things like jan.ai and a a lot more.

  • permalink
  • fedilink
  • source
    •