• 0 Posts
  • 18 Comments
Joined 2 years ago
cake
Cake day: July 23rd, 2023

help-circle


  • If you mean that you are using Proton VPN on your Raspberry Pi to mask your downloading traffic, then no that same VPN will not help you access services like Jellyfin on your home network while you are remote.

    Instead you’ll want to use something like Tailscale (or Wireguard). You run it as a service on your home network and it then becomes your own VPN that you (or others) can use to connect to your home network when you are remote.

    You could run Wireguard on the same RaspberryPi that you use for downloading but I would recommend against it assuming that you’re running Proton VPN right on the host itself (and not inside a container).












  • I’ve been testing Ollama in Docker/WSL with the idea that if I like it I’ll eventually move my GPU into my home server and get an upgrade for my gaming pc. When you run a model it has to load the whole thing into VRAM. I use the 8gb models so it takes 20-40 seconds to load the model and then each response is really fast after that and the GPU hit is pretty small. After I think five minutes by default it will unload the model to free up VRAM.

    Basically this means that you either need to wait a bit for the model to warm up or you need to extend that timeout so that it stays warm longer. That means that I cannot really use my GPU for anything else while the LLM is loaded.

    I haven’t tracked power usage, but besides the VRAM requirements it doesn’t seem too intensive on resources, but maybe I just haven’t done anything complex enough yet.





  • In my opinion trying to set up a highly available fault tolerant homelab adds a large amount of unnecessary complexity without an equivalent benefit. It’s good to have redundancy for essential services like DNS, but otherwise I think it’s better to focus on a robust backup and restore process so that if anything goes wrong you can just restore from a backup or start containers on another node.

    I configure and deploy all my applications with Ansible roles. It can programmatically create config files, pass secrets, build or start containers, cycle containers automatically after config changes, basically everything you could need.

    Sure it would be neat if services could fail over automatically but things only ever tend to break when I’m making changes anyway.