you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago (2 children)

Do we have any llama apk/deb/flatpack/appimage where you just choose the llm to use?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 2 years ago

    lamacpp is kind of this. you give it a path to a model and a prompt. download a smallish model GGUF file by thebloke. lamacpp main exec has an interactive mode too which can function like a chatbot. i never built it on android though maybe you need android NDK

  • source
  • parent