▲ 328 ▼ any cool ideas what i could do with termux? (lemmy.ml) submitted 2 years ago by SaltyIceteaMaker@lemmy.ml to c/linux@lemmy.ml 113 comments fedilink hide all child comments
[–] art@lemmy.world 2 points 2 years ago (1 child) I got llama to compile but it crashes every time I tried running it. permalink fedilink source parent hideshow 2 child comments replies: [–] Suoko@feddit.it 1 point 2 years ago (2 children) Do we have any llama apk/deb/flatpack/appimage where you just choose the llm to use? permalink fedilink source parent hideshow 4 child comments replies: [–] gens@programming.dev 1 point 2 years ago (1 child) Idk if GPT4All is what you want. permalink fedilink source parent hideshow 2 child comments replies: [–] Suoko@feddit.it 1 point 2 years ago (1 child) Do we have apt install gtp4qll? permalink fedilink source parent hideshow 2 child comments replies: [–] gens@programming.dev 1 point 2 years ago https://gpt4all.io/index.html Says ubuntu, works fine on my non-apt distro. permalink fedilink source parent [–] ddx7@lemmy.world 1 point 2 years ago lamacpp is kind of this. you give it a path to a model and a prompt. download a smallish model GGUF file by thebloke. lamacpp main exec has an interactive mode too which can function like a chatbot. i never built it on android though maybe you need android NDK permalink fedilink source parent
[–] Suoko@feddit.it 1 point 2 years ago (2 children) Do we have any llama apk/deb/flatpack/appimage where you just choose the llm to use? permalink fedilink source parent hideshow 4 child comments replies: [–] gens@programming.dev 1 point 2 years ago (1 child) Idk if GPT4All is what you want. permalink fedilink source parent hideshow 2 child comments replies: [–] Suoko@feddit.it 1 point 2 years ago (1 child) Do we have apt install gtp4qll? permalink fedilink source parent hideshow 2 child comments replies: [–] gens@programming.dev 1 point 2 years ago https://gpt4all.io/index.html Says ubuntu, works fine on my non-apt distro. permalink fedilink source parent [–] ddx7@lemmy.world 1 point 2 years ago lamacpp is kind of this. you give it a path to a model and a prompt. download a smallish model GGUF file by thebloke. lamacpp main exec has an interactive mode too which can function like a chatbot. i never built it on android though maybe you need android NDK permalink fedilink source parent
[–] gens@programming.dev 1 point 2 years ago (1 child) Idk if GPT4All is what you want. permalink fedilink source parent hideshow 2 child comments replies: [–] Suoko@feddit.it 1 point 2 years ago (1 child) Do we have apt install gtp4qll? permalink fedilink source parent hideshow 2 child comments replies: [–] gens@programming.dev 1 point 2 years ago https://gpt4all.io/index.html Says ubuntu, works fine on my non-apt distro. permalink fedilink source parent
[–] Suoko@feddit.it 1 point 2 years ago (1 child) Do we have apt install gtp4qll? permalink fedilink source parent hideshow 2 child comments replies: [–] gens@programming.dev 1 point 2 years ago https://gpt4all.io/index.html Says ubuntu, works fine on my non-apt distro. permalink fedilink source parent
[–] gens@programming.dev 1 point 2 years ago https://gpt4all.io/index.html Says ubuntu, works fine on my non-apt distro. permalink fedilink source parent
[–] ddx7@lemmy.world 1 point 2 years ago lamacpp is kind of this. you give it a path to a model and a prompt. download a smallish model GGUF file by thebloke. lamacpp main exec has an interactive mode too which can function like a chatbot. i never built it on android though maybe you need android NDK permalink fedilink source parent
