RAM & Storage Allocation
RAM pool distribution across Supermicro hosts and storage plans for Site A ZFS and Site B Ceph.
RAM and storage are split by role: 17 × 32 GB DDR4 ECC RDIMMs are distributed across Supermicro hosts; ThinkPads use their own SO-DIMM inventory. Storage divides between sa-stor-01 running ZFS at Site A and a five-node Ceph cluster at Site B.
RAM
32 GB RDIMM Pool
Seventeen 32 GB DDR4 ECC RDIMM sticks cover all Supermicro hosts except sa-stor-01, which carries its own installed memory. ThinkPads (sa-cmp-01, sa-cmp-02) cannot accept RDIMM server RAM and are excluded from this pool.
| Host | Sticks | Total | Site |
|---|---|---|---|
sa-edge-01 | 2 × 32 GB | 64 GB | Site A |
sb-edge-01 | 2 × 32 GB | 64 GB | Site B |
sb-cmp-01 (FN8TP #1) | 3 × 32 GB | 96 GB | Site B |
sb-cmp-02 (FN8TP #2) | 3 × 32 GB | 96 GB | Site B |
sb-cmp-03 (FN4T #1) | 3 × 32 GB | 96 GB | Site B |
sb-cmp-04 (FN4T #2) | 2 × 32 GB | 64 GB | Site B |
sb-cmp-05 (FN4T #3) | 2 × 32 GB | 64 GB | Site B |
| Total | 17 × 32 GB | 544 GB |
To bring every non-5049A-T Supermicro host to 128 GB, 28 × 32 GB sticks are needed — 11 more than the current 17.
sa-stor-01 Memory
sa-stor-01 (Supermicro 5049A-T, X11SPA-T board) has 96 GB installed: 6 × 16 GB DDR4-2933 ECC RDIMM (PC4-23400).
Tentative — upgrade path not yet confirmed
Three upgrade options are under consideration. None has been ordered or finalized.
| Option | Change | Resulting total |
|---|---|---|
| A | Add 6 × 16 GB DDR4-2933 ECC RDIMM (matching sticks) | 192 GB |
| B | Add 6 × 32 GB DDR4-2933 ECC RDIMM | 288 GB |
| C | Replace all with 12 × 32 GB DDR4-2933 ECC RDIMM | 384 GB |
Do not mix RDIMM and LRDIMM in the same system. Avoid asymmetric single-stick upgrades.
Storage
Drive Inventory
| Model | Capacity | Count | Form factor |
|---|---|---|---|
| Samsung SM863 | 1.92 TB | 20 | SATA SSD |
| Micron 5200 MAX | 1.92 TB | 10 | SATA SSD |
| Micron 5300 Pro | 1.92 TB | 8 | SATA SSD |
| Samsung 512 GB NVMe M.2 | 512 GB | 5 | NVMe M.2 |
| Samsung SM9A1 | 512 GB | 1 | NVMe M.2 |
| Micron 1300 | 512 GB | 1 | SATA M.2 |
Boot Drives
All Proxmox hosts use 512 GB M.2 drives as boot volumes. sa-stor-01 already has a boot drive installed.
Never use enterprise SSDs for boot
1.92 TB drives — Samsung SM863, Micron 5200 MAX, Micron 5300 Pro — are entirely allocated to ZFS vdevs and Ceph OSDs. None should be used as a boot drive.
| Host | Boot drive |
|---|---|
sa-stor-01 | Existing boot drive (installed) |
sa-edge-01 | 512 GB NVMe M.2 |
sb-edge-01 | 512 GB NVMe M.2 |
sb-cmp-01 | 512 GB NVMe M.2 |
sb-cmp-02 | 512 GB NVMe M.2 |
sb-cmp-03 | 512 GB NVMe M.2 |
sb-cmp-04 | 512 GB M.2 (NVMe or SATA) |
sb-cmp-05 | Micron 1300 512 GB SATA M.2 |
Site A — ZFS on sa-stor-01
sa-stor-01 runs ZFS mirror vdevs using Samsung SM863 1.92 TB drives. This pool backs Proxmox Backup Server (PBS-A), DNS VMs, monitoring, databases, and core infrastructure VMs.
| Drive count | ZFS layout | Mirror vdevs |
|---|---|---|
| 8 | 4 × mirror-2 | 4 |
| 12 | 6 × mirror-2 | 6 |
See Site A ZFS for pool creation and dataset layout.
Site B — Ceph
Ceph runs across five Site B nodes with 20–30 OSDs total and replication size 3. Each node contributes 4–6 × 1.92 TB enterprise SSDs.
| Host | Platform | SSDs per node |
|---|---|---|
sb-cmp-01 | SYS-5019D-4C-FN8TP | 4–6 |
sb-cmp-02 | SYS-5019D-4C-FN8TP | 4–6 |
sb-cmp-03 | SYS-5018D-FN4T | 4–6 |
sb-cmp-04 | SYS-5018D-FN4T | 4–6 |
sb-cmp-05 | SYS-5018D-FN4T | 4–6 |
Drive model selection follows workload type:
| Model | Recommended use |
|---|---|
| Micron 5200 MAX 1.92 TB | Write-heavy OSDs and workloads |
| Micron 5300 Pro 1.92 TB | VM storage and Kubernetes persistent volumes |
| Samsung SM863 1.92 TB | Flexible — remaining OSDs or cold spares (reserve 2–4 drives) |
See Site B Ceph for OSD layout and pool configuration.
Related Pages
- Per-Site Inventory — full hardware list by site
- NIC Allocation — 10 G multiport NIC distribution
- Site A ZFS — ZFS pool and dataset design
- Site B Ceph — Ceph OSD layout and pool configuration
- PBS & Backups — PBS-A and PBS-B backup infrastructure
NIC Inventory & Allocation
Definitive accounting of all network interface cards across both sites: the 6 × 10G multiport add-in cards, 2 × Intel X550-T2 for the ThinkPads, onboard NIC counts by platform, and per-node VLAN wiring maps.
E200 Fan Quieting
Runbook to quiet the Supermicro SYS-E200-8D 40 mm chassis fan on sa-edge-01 and sb-edge-01 using IPMI fan mode control, BMC threshold tuning, and an optional Noctua fan swap.