Homelab

An ongoing project for services I run at home. Everything is managed as code in ryanrishi/homelab.

Today

Internet
Verizon Fios gatewayNAT
UniFi Dream MachineNAT · firewall
Default VLAN192.168.0.0/24
  • laptops
  • phones
  • iPad
IoT VLAN192.168.2.0/24
  • Philips Hue bridge
  • smart lights
  • Sonos
Homelab VLAN192.168.4.0/24
TP-Link switchunmanaged
Proxmox cluster
Intel NUC
  • k3s-server
  • k3s-agent
  • k3s-agent · iGPU
Intel NUC
  • k3s-server
  • k3s-agent
  • k3s-agent · iGPU
Lenovo M920q
  • k3s-server
  • k3s-agent
Synology DS218+
  • backups
  • media
k3s cluster3 servers · 5 agents
  • Pi-hole
  • Plex + *arr
  • Home Assistant
  • kube-prometheus-stack
  • Loki
  • camping bot
  • email organizer
  • ddclient

runs on

  • Flux
  • Traefik
  • MetalLB
  • Longhorn
  • SOPS

Three mini PCs form a Proxmox cluster. Terraform creates the VMs, and cloud-init runs Ansible on first boot to join each VM to a k3s cluster. Flux deploys everything in the cluster from Git, with secrets encrypted by SOPS. Longhorn replicates volumes across nodes, the Synology NAS holds backups and media, and kube-prometheus-stack sends alerts to my phone.

How it got here

  1. 2006

    Dynamic DNS on the family PC

    I set up DynDNS on my family's home PC so that I could access my iTunes library from my school's computer lab.

  2. 2013

    A Raspberry Pi

    A Raspberry Pi at my family's house ran long-running CS projects that I didn't want to run on my laptop. SSH was exposed to the public internet. I was young and naive.

  3. 2013–2020

    A VPS

    A DigitalOcean VPS ran my website for a while, and then replaced the Raspberry Pi. I got increasingly sick of paying the monthly fee.

  4. Spring 2020

    Ansible, Pis, and the first NUC

    I suddenly had a lot of time at home, so I revived a few Raspberry Pis and installed Grafana, InfluxDB, Telegraf, the *arr services, and ddclient. I managed them by hand over SSH at first, then with Ansible, which I was using a lot at work. ARM wasn't a great fit for those services, so I bought an Intel NUC and a 2-bay NAS, installed Proxmox on the NUC, and moved everything into VMs.

  5. August 2020

    A second site

    I replicated the NUC + NAS setup at my family's vacation home, and added a WireGuard VM so that I could access services while away. I acknowledged that all future WiFi outages would be blamed on my servers.

  6. 2021

    Offsite backups

    I set up Time Machine on both NUC + NAS setups so that I had offsite backups.

  7. March 2023

    NYC

    After one too many "why isn't the internet working, are your computers messing with it?" accusations, I brought my main NUC + NAS to NYC and started reviving the homelab in a new network.

  8. November 2023

    UniFi and VLANs

    My first UniFi equipment meant I could finally separate the network into VLANs: IoT, homelab, and everything else. I tried AdGuard on the UniFi router instead of Pi-hole, but I wasn't impressed, because I couldn't decide what to allow and what to block.

  9. Spring 2024

    k3s

    Upgrading Ansible-managed VMs was fragile, and my services relied too heavily on router-configured DNS to find each other, so I bit the bullet and installed k3s on about seven VMs, all on one physical host. In April I figured out MetalLB, which gives services in the cluster their own IPs on the LAN, starting with Pi-hole.

  10. Mid-2025

    Out of memory

    One physical node with 16 GB of RAM can't comfortably run three k3s control plane nodes in addition to my existing VMs and LXCs.

  11. Late 2025

    A Proxmox cluster

    I bought a Lenovo M720s off Facebook Marketplace and added it as a second Proxmox node. I learned the hard way about corosync, because the cluster kept becoming unresponsive. It turned out to be a bad Ethernet cable.

  12. January 2026

    Home Assistant and a flaky NIC

    I installed Home Assistant on k3s, and failures started almost immediately: its mDNS traffic triggered e1000e driver hangs on the M720s's Intel I219-V NIC. I bought a Lenovo M920q off eBay to replace it.

  13. May 2026

    Storage

    I added a second disk to each k3s agent VM and set up Longhorn for replicated storage. I also mitigated the e1000e hangs by disabling TSO and GSO on the NICs.

  14. July 2026

    A third node

    I brought the second NUC from my family's vacation home to NYC and added it to the Proxmox cluster as a third node.

  15. 2026

    Writing my own services

    I started writing my own services: a revamped version of my camping reservation bot, and an email organizer that scans my inbox every 15 minutes and classifies emails as recruiter mail, shopping, and so on.