you are viewing a single comment's thread
view the rest of the comments
[–] [S] 8 points 1 year ago* (last edited 1 year ago)

Basically it’s a layer to let your LLMs plug into tools.

They generally run on your machine (I use docker to sandbox them) and may or may not call out to useful APIs

One example is I just wrote one to connect to my national weather services RSS feed, so my LLMs can get and summarize the weather for me in the morning.

Works well with Gemma 3n

  • source
  • parent