This is pretty rad! Thanks for sharing. I went down the same road with learning k3s on about 7 Raspberry Pis and pivoted over to Proxmox/Ceph on a few old gaming PCs / Ethereum miners. Now I am trying to optimize the space and looking at how to rack mount my ATX machines with GPUs lol… I was able to get a RTX 3070 to fit in a 2U rack mount enclosure but having some heat issues… going to look at 4U cases with better airflow for the RTX 3090 and various RX480s.

I am planning to set up Talos VMs (one per Proxmox host) and bootstrap k8s with Traefik and others. If you’re learning, you might want to start with a batteries-included k8s distro like k3s.

I followed the wiki tutorials for that. Make sure iommu is working, blacklist drivers on host, etc.

It’s on my lift of projects. I build a Proxmox+Ceph cluster and I have GPU passthrough working for LLM inference. I was planning to get docker headless Steam going and try to steam via Steam In Home Streaming as my first attempt then pivot to a full VM with Sunshine as a last resort.