An ongoing project for services I run at home. Everything is managed as code in ryanrishi/homelab.
runs on
Three mini PCs form a Proxmox cluster. Terraform creates the VMs, and cloud-init runs Ansible on first boot to join each VM to a k3s cluster. Flux deploys everything in the cluster from Git, with secrets encrypted by SOPS. Longhorn replicates volumes across nodes, the Synology NAS holds backups and media, and kube-prometheus-stack sends alerts to my phone.
2006
I set up DynDNS on my family's home PC so that I could access my iTunes library from my school's computer lab.
2013
A Raspberry Pi at my family's house ran long-running CS projects that I didn't want to run on my laptop. SSH was exposed to the public internet. I was young and naive.
2013–2020
A DigitalOcean VPS ran my website for a while, and then replaced the Raspberry Pi. I got increasingly sick of paying the monthly fee.
Spring 2020
I suddenly had a lot of time at home, so I revived a few Raspberry Pis and installed Grafana, InfluxDB, Telegraf, the *arr services, and ddclient. I managed them by hand over SSH at first, then with Ansible, which I was using a lot at work. ARM wasn't a great fit for those services, so I bought an Intel NUC and a 2-bay NAS, installed Proxmox on the NUC, and moved everything into VMs.
August 2020
I replicated the NUC + NAS setup at my family's vacation home, and added a WireGuard VM so that I could access services while away. I acknowledged that all future WiFi outages would be blamed on my servers.
2021
I set up Time Machine on both NUC + NAS setups so that I had offsite backups.
March 2023
After one too many "why isn't the internet working, are your computers messing with it?" accusations, I brought my main NUC + NAS to NYC and started reviving the homelab in a new network.
November 2023
My first UniFi equipment meant I could finally separate the network into VLANs: IoT, homelab, and everything else. I tried AdGuard on the UniFi router instead of Pi-hole, but I wasn't impressed, because I couldn't decide what to allow and what to block.
Spring 2024
Upgrading Ansible-managed VMs was fragile, and my services relied too heavily on router-configured DNS to find each other, so I bit the bullet and installed k3s on about seven VMs, all on one physical host. In April I figured out MetalLB, which gives services in the cluster their own IPs on the LAN, starting with Pi-hole.
Mid-2025
One physical node with 16 GB of RAM can't comfortably run three k3s control plane nodes in addition to my existing VMs and LXCs.
Late 2025
I bought a Lenovo M720s off Facebook Marketplace and added it as a second Proxmox node. I learned the hard way about corosync, because the cluster kept becoming unresponsive. It turned out to be a bad Ethernet cable.
January 2026
I installed Home Assistant on k3s, and failures started almost immediately: its mDNS traffic triggered e1000e driver hangs on the M720s's Intel I219-V NIC. I bought a Lenovo M920q off eBay to replace it.
May 2026
I added a second disk to each k3s agent VM and set up Longhorn for replicated storage. I also mitigated the e1000e hangs by disabling TSO and GSO on the NICs.
July 2026
I brought the second NUC from my family's vacation home to NYC and added it to the Proxmox cluster as a third node.
2026
I started writing my own services: a revamped version of my camping reservation bot, and an email organizer that scans my inbox every 15 minutes and classifies emails as recruiter mail, shopping, and so on.