Looking for a recommendation on an LLM that can guide a user on how to manually set up a home server that runs Jellyfin, Arr Stack, etc. Have a couple of friends interested and I have some spare old NUCs I was going to give them, so I was going to download the software for them and then walk them through it.

But it'll be difficult to align our schedules for the next month or so (school starting and different time zones) so then I thought maybe I could just run an LLM they could use on my main PC for when they have time.

Why not just use one of the existing services? Those cost extra money and none of us want to financially support those companies.

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 1 day ago (4 children)

GPT4All can accommodate a plethora of models all the way until you run out of VRAM. LOL Maybe play around with some of them. Right now I'm experimenting with DeepSeek R1 Distill Qwen 14 B, and Qwen 2.5 Coder -32B Instruct GGUF. Pretty neat stuff.

  • source
  • hideshow 7 child comments
  • [–] [S] 2 points 1 day ago (2 children)

    Is GPT4all still up to date though? I see the last release was in 2024

  • source
  • parent
  • hideshow 4 child comments
  • [–] 0 points 1 day ago (1 child)

    Mature software doesn't need hourly updates. All the shit that leverages the library repos in horribly unsafe ways - ohai npm - that stuff needs constant updates.

  • source
  • parent
  • hideshow 2 child comments
  • [–] [S] 1 point 11 hours ago

    I know it doesn't need hourly updates but something that relies on other data (in this case LLMs) probably needs yearly updates at the very least to ensure better compatibility with newer models.

  • source
  • parent
  • load more comments (1 reply)