Hardware
Physical hardware inventory for both sites: edge servers, storage hosts, compute nodes, 10 Gb switches, NIC pool, storage drives, and RAM.
Hardware documents every physical device and its role. Site A's approved target uses three UniFi Switch Pro XG 10 PoE devices as an L2 RSTP fabric behind OPNsense. Site B retains its Netgear L2 core; server, storage, and NIC allocations are unchanged.
Site A
Site A (10.10.0.0/16) runs management, ZFS storage, Proxmox Backup Server (PBS), DNS, and monitoring.
| Hostname | Hardware | Role |
|---|---|---|
sa-edge-01 | Supermicro SYS-E200-8D | Proxmox host; OPNsense VM (sa-fw-01), WireGuard, utility workloads |
sa-cmp-01 | Lenovo ThinkPad P51 | Proxmox worker / CI / dev (Intel X550-T2) |
sa-cmp-02 | Lenovo ThinkPad P52 | Proxmox worker / GPU / AI / build (Intel X550-T2) |
sa-stor-01 | Supermicro 5049A-T | ZFS mirror, PBS-A, sa-dns-01, monitoring, databases |
Switches: three USW-Pro-XG-10-PoE devices (sa-sw-01/02/03) form the L2
RSTP triangle. sa-ap-01 moves to sa-sw-03 port 6. The UCG Max and XG 6 PoE
currently serve bootstrap and become retained rollback spares after Gate A8.
sa-stor-01 Onboard NIC Caveat
The 5049A-T (X11SPA-T board) has one onboard 1GbE Intel i210 (Proxmox mgmt, the red RJ45) and one onboard 10GBASE-T Aquantia AQC107. The AQC107 (atlantic driver) is avoided for critical traffic: Corosync runs on the add-in XL710/X710-class card instead.
Site B
Site B (10.20.0.0/16) runs Ceph distributed storage, Kubernetes/OpenShift, and high-core compute.
| Hostname | Hardware | Role |
|---|---|---|
sb-edge-01 | Supermicro SYS-E200-8D | Proxmox host; OPNsense VM (sb-fw-01), WireGuard, utility workloads |
sb-cmp-01 | SYS-5019D-4C-FN8TP | Cluster bootstrap, Ceph MON/MGR, Kubernetes control-plane |
sb-cmp-02 | SYS-5019D-4C-FN8TP | Ceph MON/MGR, Kubernetes control-plane |
sb-cmp-03 | SYS-5018D-FN4T | Ceph OSD, Kubernetes worker |
sb-cmp-04 | SYS-5018D-FN4T | Ceph OSD, Kubernetes worker |
sb-cmp-05 | SYS-5018D-FN4T | Ceph OSD, Kubernetes worker |
Switches: sb-sw-01 (Netgear XS748T) is the 10 Gb L2 core. sb-sw-02 (UniFi USW 24 PoE) handles access, APs, and PoE devices. The USG Pro is bootstrap/fallback only.
NIC Pool
Six multiport 10 Gb NICs are in inventory; all are allocated with no spare (confirmed 2026-06-06).
| Card | Qty | Allocation |
|---|---|---|
| Intel X710-T4 | 5 | One per Site B node: sb-cmp-01-sb-cmp-05 |
| XL710/X710-class quad-port | 1 | Pre-installed in sa-stor-01 (VLAN trunks, Corosync) |
| Intel X550-T2 | 2 | One each for sa-cmp-01 and sa-cmp-02 |
No spare X710-T4 remains and no Site B node carries two cards. See NIC Allocation for per-port VLAN wiring.
Storage Pools
Storage inventory spans three 1.92 TB enterprise SSD families and 512 GB M.2 boot drives.
Data drives:
| Model | Qty | Priority use |
|---|---|---|
| Samsung SM863 | 20 | Site A ZFS mirrors; flexible Site B Ceph or spares |
| Micron 5200 MAX | 10 | Site B Ceph, write-heavy OSDs |
| Micron 5300 Pro | 8 | Site B Ceph, VM / Kubernetes persistent storage |
Boot drives:
| Model | Qty | Form factor |
|---|---|---|
| Samsung 512GB NVMe M.2 | 5 | NVMe M.2 |
| Samsung SM9A1 NVMe M.2 | 1 | NVMe M.2 |
| Micron 1300 SATA M.2 | 1 | SATA M.2 |
sa-stor-01 targets 8-12 SM863 drives in ZFS mirror vdevs. Site B targets 20-30 Ceph OSDs across all five compute nodes at replication size 3. The 5049A-T already has a boot drive; do not use 1.92 TB enterprise SSDs as Proxmox boot drives.
RAM Pool
All Supermicro servers use DDR4 ECC RDIMM. ThinkPads cannot accept RDIMM.
- 17 × 32 GB DDR4 RDIMM available for distribution across Supermicro hosts.
sa-stor-01(5049A-T) already has 96 GB (6 × 16 GB DDR4-2933 ECC RDIMM).- To bring every non-5049 Supermicro to 128 GB requires 28 × 32 GB sticks: 11 more beyond current inventory.
5049A-T RAM Upgrade Path Not Confirmed
Upgrade options range from 192 GB (add 6 × 16 GB) to 384 GB (replace with 12 × 32 GB). The decision has not been finalized. Do not mix RDIMM and LRDIMM. See RAM & Storage Allocation.
Hardware References
- Per-site Inventory: complete host tables with per-NIC, RAM, and storage columns
- NIC Allocation: per-card assignment and per-port VLAN wiring
- RAM & Storage Allocation: drive-to-host and RAM-to-host mapping, ZFS and Ceph pool plans