This describes the evolution of my personal home lab.
It’s a Red Hat oVirt Cluster with Shared Storage…
The garage rack consists of: –
- x3 Compute Nodes, x2 Storage Nodes (connected via 20gbit teamed SAN)
- 1500W UPS
- x1 Physical oVirt Engine Server, x1 Physical AD Controller, x1 Raspberry PI with PiHole.
- x24 port gigabit switch with x2 10gbit SFP+ to network cab
- x8 port 10gbit SFP+ switch – dedicated for the SAN
- x4 dedicated physical gigabit or greater networks – bulk file transfer, management, extranet, SAN
- Several VLANs / VNETs including OVN port isolated vswitches for client VM isolation
- x4 GPU VM passthrough cards in a multi GPU chassis (the black 4u with temp gauge) two of which run via a 50m underground cable to my house which I use as desktops. The others perform CAD rendering and transcoding operations.
- Nested Virtualisation Enabled
- Live Migration Enabled
- Multi-node Load Balancing (provided by OPNsense) – network cab in the house
- TrueNAS Core SAN nodes, mixture of NVMe and Rust Z2 but hoping to switch to TrueNAS SCALE when it’s officially release for GlusterFS.
House network cabinet: –
- x1 Physical OPNsense Server
- x24 port gigabit switch with x2 10gbit SFP+ to garage
- x1 TriBand WAP
- x1 230W UPS
The middle 4u (currently off) waiting for a heat sink, is a dual socket xeon 8160 with 16 dimm slots supporting 96 threads and .5TB RAM.
I’m hoping to move the current docker containers it’s running over to kubernetes, but still working on a test cluster to learn this.
Last tower rack mounted in a 2U case.
Work in-progress, last of the existing towers still to be rack mounted.
