Hardware

Hardware

Physical hardware inventory for both sites: edge servers, storage hosts, compute nodes, 10 Gb switches, NIC pool, storage drives, and RAM.

Hardware documents every physical device and its role. Site A's approved target uses three UniFi Switch Pro XG 10 PoE devices as an L2 RSTP fabric behind OPNsense. Site B retains its Netgear L2 core; server, storage, and NIC allocations are unchanged.

Site A

Site A (10.10.0.0/16) runs management, ZFS storage, Proxmox Backup Server (PBS), DNS, and monitoring.

HostnameHardwareRole
sa-edge-01Supermicro SYS-E200-8DProxmox host; OPNsense VM (sa-fw-01), WireGuard, utility workloads
sa-cmp-01Lenovo ThinkPad P51Proxmox worker / CI / dev (Intel X550-T2)
sa-cmp-02Lenovo ThinkPad P52Proxmox worker / GPU / AI / build (Intel X550-T2)
sa-stor-01Supermicro 5049A-TZFS mirror, PBS-A, sa-dns-01, monitoring, databases

Switches: three USW-Pro-XG-10-PoE devices (sa-sw-01/02/03) form the L2 RSTP triangle. sa-ap-01 moves to sa-sw-03 port 6. The UCG Max and XG 6 PoE currently serve bootstrap and become retained rollback spares after Gate A8.

sa-stor-01 Onboard NIC Caveat

The 5049A-T (X11SPA-T board) has one onboard 1GbE Intel i210 (Proxmox mgmt, the red RJ45) and one onboard 10GBASE-T Aquantia AQC107. The AQC107 (atlantic driver) is avoided for critical traffic: Corosync runs on the add-in XL710/X710-class card instead.

Site B

Site B (10.20.0.0/16) runs Ceph distributed storage, Kubernetes/OpenShift, and high-core compute.

HostnameHardwareRole
sb-edge-01Supermicro SYS-E200-8DProxmox host; OPNsense VM (sb-fw-01), WireGuard, utility workloads
sb-cmp-01SYS-5019D-4C-FN8TPCluster bootstrap, Ceph MON/MGR, Kubernetes control-plane
sb-cmp-02SYS-5019D-4C-FN8TPCeph MON/MGR, Kubernetes control-plane
sb-cmp-03SYS-5018D-FN4TCeph OSD, Kubernetes worker
sb-cmp-04SYS-5018D-FN4TCeph OSD, Kubernetes worker
sb-cmp-05SYS-5018D-FN4TCeph OSD, Kubernetes worker

Switches: sb-sw-01 (Netgear XS748T) is the 10 Gb L2 core. sb-sw-02 (UniFi USW 24 PoE) handles access, APs, and PoE devices. The USG Pro is bootstrap/fallback only.

NIC Pool

Six multiport 10 Gb NICs are in inventory; all are allocated with no spare (confirmed 2026-06-06).

CardQtyAllocation
Intel X710-T45One per Site B node: sb-cmp-01-sb-cmp-05
XL710/X710-class quad-port1Pre-installed in sa-stor-01 (VLAN trunks, Corosync)
Intel X550-T22One each for sa-cmp-01 and sa-cmp-02

No spare X710-T4 remains and no Site B node carries two cards. See NIC Allocation for per-port VLAN wiring.

Storage Pools

Storage inventory spans three 1.92 TB enterprise SSD families and 512 GB M.2 boot drives.

Data drives:

ModelQtyPriority use
Samsung SM86320Site A ZFS mirrors; flexible Site B Ceph or spares
Micron 5200 MAX10Site B Ceph, write-heavy OSDs
Micron 5300 Pro8Site B Ceph, VM / Kubernetes persistent storage

Boot drives:

ModelQtyForm factor
Samsung 512GB NVMe M.25NVMe M.2
Samsung SM9A1 NVMe M.21NVMe M.2
Micron 1300 SATA M.21SATA M.2

sa-stor-01 targets 8-12 SM863 drives in ZFS mirror vdevs. Site B targets 20-30 Ceph OSDs across all five compute nodes at replication size 3. The 5049A-T already has a boot drive; do not use 1.92 TB enterprise SSDs as Proxmox boot drives.

RAM Pool

All Supermicro servers use DDR4 ECC RDIMM. ThinkPads cannot accept RDIMM.

  • 17 × 32 GB DDR4 RDIMM available for distribution across Supermicro hosts.
  • sa-stor-01 (5049A-T) already has 96 GB (6 × 16 GB DDR4-2933 ECC RDIMM).
  • To bring every non-5049 Supermicro to 128 GB requires 28 × 32 GB sticks: 11 more beyond current inventory.

5049A-T RAM Upgrade Path Not Confirmed

Upgrade options range from 192 GB (add 6 × 16 GB) to 384 GB (replace with 12 × 32 GB). The decision has not been finalized. Do not mix RDIMM and LRDIMM. See RAM & Storage Allocation.

Hardware References