Finally got my three node proxmox/ceph cluster up and running. Upgraded each node with a 500GB WD black nvme drive (ceph OSD), 250GB SATA boot SSD, additional 16GB dimm (total 20GB each), and a connectx-3 dual sfp+ NIC for a 10Gb mesh storage network backend.
Picked up a cheap MPU2016 IPKVM and a switched PDU for a poor man’s IPMI.
Will run some benchmarks, but I am thinking these celeron CPUs might be a bit under-powered for the task at hand. I think an i3-8100 or i3-9100 would be better suited. Perhaps a future upgrade.
In all, each node I spent under $300 on (tax+ship included in prices):
- HP 290-p0043w - $115
- 16GB dimm CT16G4DFD824A - $64.37
- WD SN550 500G nvme w/ heatsink - $73.36
- Connectx-3 CX312A + low profile bracket - $26.29
- SFP+ DAC cable - $11.81
- 250G SATA SSD - $0 (had laying around)
Total (per node): $290.83