13
[AIT] Local LLM for Server Setup Guidance? (lemmy.world)
submitted 1 day ago* (last edited 1 day ago) by to c/selfhosted@lemmy.world
26 comments fedilink hide all child comments
 

Looking for a recommendation on an LLM that can guide a user on how to manually set up a home server that runs Jellyfin, Arr Stack, etc. Have a couple of friends interested and I have some spare old NUCs I was going to give them, so I was going to download the software for them and then walk them through it.

But it'll be difficult to align our schedules for the next month or so (school starting and different time zones) so then I thought maybe I could just run an LLM they could use on my main PC for when they have time.

Why not just use one of the existing services? Those cost extra money and none of us want to financially support those companies.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 2 points 1 day ago (2 children)

Any step-by-step text guides you'd recommend? They're not exactly tech beginners, but they're also not quite knowledgeable yet. I guided them through Linux install but they use Bazzite and mostly stick to Bazaar on it for any programs they need.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 1 day ago (1 child)

    Maybe a easier place to start is a beginner friendly system? Lots of people like running Unraid for example, and they have lots of apps that will make it easier to get into (https://ca.unraid.net/), that might help ease them into it. Being thrown into a Linux terminal might feel daunting, but also a great way to learn.

    I think many just need to get hooked on it, then they more naturally feel like they want to customize and try out stuff.

    I dont have any guide recommendations, since its been a while since I started. You can probably do some searching on the stuff you want them to setup.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] [S] 1 point 1 day ago (1 child)

    I asked mostly because I haven't seen any guides like that. The long video guides are also usually outdated or a very specific method that's more advanced (like bare metal setup or using ignition)

    My plan was to lead them through something like what I use which is base Debian using Dockge and a reverse proxy (though I'm looking into KDE Plasma BigScreen). I think they might be able to figure it out with help and some general written instructions and the AI for further questions.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 1 day ago (1 child)

    For the arr stack the best resource I know is https://wiki.servarr.com/ which I referenced for my setup in Kubernetes.

    Most projects have pretty good documentation on how to setup their services, in many cases its just the Docker config afterall.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] [S] 2 points 19 hours ago

    It's a good reference guide, yes, but it's not good for beginners. The linked TRaSH guide seems better but I think are still a lot.

    The issue I've found when searching for resources for them is that there's really no guide me for people who know very little but want to do this and guides them in the proper steps from beginning to end. I have an IT degree and even I remember struggling a little bit when I first delved into self hosting because I never really studied networking, and networking feels like a different field entirely. Right now self hosting in general reminds me of the early days of Slackware (maybe even SLS) Linux (for those that remember) - you kind of have to ask around and figure things out on your own through a bunch of lookup.

    I'm trying to ease the friction a little bit for those that want too start, and want to see if an LLM that can quickly define some words and tell you not only where to start but the steps after that based on your skill/knowledge level can ease some of that friction.

    At least until one day self hosting becomes about as easy as modern Linux.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 1 day ago* (last edited 22 hours ago)

    Is it just for local usage on their network or will their be remote access via the internet? What OS are they installing on? Are they familiar with installing the OS?

    In my experience Jellyfin is an easy install and easy to manage.

    I run a few servers on an old laptop and I've messed up some random other shit on the laptop then wiped it one time, moved to another OS one time, moved to another machine another time. So I've setup Jellyfin I think 4 times now.

    Overall it's pretty easy in my opinion.

    1. Find your ip- ifconfig

    2.Log into router and reserve that IP so it stays with the device. (This will vary by internet service provider, if unsure look at the gateway you found in the last step, if it says 192.168.1.254 or such, that's it)

    1. If using it local punch a firewall hole for 8096 so you can get to it from say your Android/Roku TV, LG TV, phone, computer, whatever.

    (Standardly something like: sudo ufw allow 8096)

    1. Terminal command listed here for the install: https://jellyfin.org/docs/general/installation/linux/

    If you like using docker like many do then you may prefer to do it in a container.

    Anyways that should bring it up. Then go to http://the.ip.address.found:8096/ and go into the dashboard to set up users, pick what access they have.

    Also where you'll set up the libraries, so say "Movies" and point it to where you store them.. you can point it to multiple directories

    Oh and if a laptop change the close lid settings to keep machine on when plugged in and lid closed. Set all power settings to not go to sleep.

    On an aside I set my VPN up as a split tunnel, easy, just Google your VPN and split tunnel, should only take a few clicks. I set qbittorrent and firefox traffic to go through the VPN, then I have everything else stay on local network.

    I install Rustdesk on my phone and laptop, then remotely access the device wherever I'm at. Use the search function in qbittorrent, tell it to download sequentially, and download to the movies directory I want, launch the jellyfin app on my phone, hold my finger down on the movies folder, tell it to refresh meta-data and then launch the jellyfin fin app on one of the tvs.

    Some time from "do you want to watch ____" to starting to watch it is ~3 minutes. If the movie downloads faster than you watch it, should have no hiccups

  • permalink
  • fedilink
  • source
  • parent