Supermicro CSE-846 & NVIDIA Quadro P5000

I’ve been running my Unraid server build (that’s based largely on the SNAFU guides here) for a few years now and it’s been running great. Thanks to everyone for all the info and guides that helped me along the way.

The server acts as my home’s all-in-one solution for numerous tasks - file server, media storage, a couple lite special purpose VMs, and a plethora of docker-based services: Home Assistant, Channels DVR, Emby, Traefik, *darr suite, Deluge, etc.

I have a spare NVIDIA Quadro P5000 that I’d like to toss into the system and passthrough to my Emby docker to do GPU transcoding. I’m running redundant Supermicro PWS-920P-SQ power supplies but the CSE-846’s PDB doesn’t have PCIe power cables (the Quadro P5000 needs 8-pin PCIe).

Is it as simple as getting a molex to PCIe 8-pin adapter cable? I was looking at these, but the Quadro’s TGP is 180w and these say they are only rated for 120w.

Any guidance here is greatly appreciated. Thanks in advance!

My full build specs are:

  • Case: Supermicro CSE-846E16-R1200B
  • PSU: Supermicro PWS-920P-SQ (x2)
  • Mobo: Supermicro X9DRD-7LN4F-JBOD Rev 1.02
  • CPUs: Intel Xenon E5-2650 v2 (x2)
  • RAM: 128GB (4x32) Samsung M386B4G70DM0-CMA4 4Rx4 PC3L-14900L
  • Backplane: BPN-SAS2-846EL1
  • PCIe1: SolarFlare SFN5122F Dual Port 10Gb/s NIC
  • PCIe2: NVME adapter (for Unraid cache drives)
  • PCIe3: NVME adapter (for Emby cache data)
  • PCIe4: — Quadro going here — (with x8 to x16 adapter)
  • PCIe5: future use, TBD (perhaps a second Quadro for a VM)
  • PCIe6: future use, TBD
  • Array: 145TB across 16 drives
  • Parity: 14TB (x2)
  • SSD Drives: two additional SSD drives (for VM use) in an internal drive caddy

Note - The x9drd-7lnf-jbod board only has x8 PCIe slots, so I have an x8-to-x16 adapter for the Quadro.

Have you considered moving to Quicksync?

You can probably sell that Quadro P5000 for a good bit considering the market right now. It should be more than enough to fund your entire build and more.

1 Like

Thanks for the reply @JDM_WAAAT. I’m definitely not opposed to going that route. The bulk of my media content is 4k x265.

I want to keep the CSE-846 for the sheer drive density capability and would prefer to maintain a single-server solution for everything I’m currently running rather than adding a second device for Emby. So swapping out the mobo/cpu/ram while maintaining the as much of the rest as possible would be ideal.

Any suggestions on hardware I should shoot for if I move to Quicksync, given the rest of my build?

I’ve recently moved from a Supermicro X9DRD-7LN4F-JBOD in an 846 case with dual Xeons on UnRaid with a GPU passed through for Emby transcoding to an X12SCA-5F with an 11th Gen Intel CPU and Quicksync transcoding.

Wish I’d done it sooner! Let me know if you want any more info @MSOBadger . I also moved away from UnRaid to Arch + MergerFS + SnapRaid at the same time - really needed those later kernels for that new CPU.

EDIT: 11th gen, not 10th gen

Thanks for the reply @Warren_Hughes - wow it sounds like we were running the exact same configuration. Which GPU were you passing through in your x9 build?

I spent today reading up on the X12SCA-5F. Looks like a nice board - it’d definitely be nice having the native nvme support. Looks like supply on them is pretty hard to come by on it at the moment.

I did some reading on Arch+MergerFS+SnapRaid as well. Looks interesting. Was it relatively seamless to change your storage drives over from your Unraid configuration? I have really liked Unraid so far, so I’d prefer not to switch away. Does the older kernel in Unraid really hamstring the newer CPUs?

Are you still using the 846 case and then just using an expander card with that board?

Hi @MSOBadger - yep - except I was running 2x Xeon 2696v2 on mine :slight_smile:

My original post was a bit wrong - I’m using an 11th Gen Intel CPU: i5-11400 on kernel 5.17 - there are lots of issues with 11th and 12th Intel CPU’s doing transcoding via iGPU on older kernels. [6.9.x - 6.10.x] intel i915 module causing system hangs with no report in syslog - Prereleases - Unraid

I couldn’t get my server to stay up for more than a day - last version of UnRaid I tried was 6.10.0-RC3. Running on Arch with 5.17 its rock solid.

Previously passing through a p4000 - now iGPU all the way! As @JDM_WAAAT suggested I used the sale of my p4000 to cover all the changes :smiley:

X12SCA-5F is amazing - everything you could possibly want in the BIOS. Took a month for my order to ship here in NZ.

I moved all my drives across to MergerFS with data and fs intact. I’ll progressively convert each drive to standalone BTRFS so that I can take advantage of how it interacts with SnapRAID GitHub - automorphism88/snapraid-btrfs: Script for using snapraid with btrfs snapshots

Yep still using the 846. Although mine is modded to use a standard ATX PSU and my front fan wall is using Noctua NF-A14 and the exhaust are Noctua NF-A8 controlled by a Corsair Commander Pro fan controller which has full Linux support:

image

I’m using an LSI 9211-8i connected to the backplane with a mix of SATA and SAS drives. Pretty sure my backplane is a BPN-SAS2-846EL1

1 Like

Thanks again for all the info @Warren_Hughes! I took a read through all of the Intel i915 thread as well.

I’m going to keep my eyes out for inventory on the X12SCA-5F; hopefully by the time inventory actually on it becomes available again the Unraid guys will have made progress towards an official 6.10 release that addresses the issue.

Regardless, I’ll make the switch to Quicksync here at some point. In the interim, it would be nice to toss this P5000 in my unit if I can figure out my original power connection conversion question.

Have you looked at the HP 290 or the HP S01? They are the best ways to get into Quicksync and barely make a dent.

Thanks @JDM_WAAAT. I’ve definitely considered the HP 290 and HP S01, but I’d ideally like to keep everything neatly organized in my rack and haven’t seen any good rackmount options/hacks/ideas for either of them, including hunting for 3D prints on Thingiverse. (If anyone has any ideas on that, I’m certainly all ears.)

(Yes, I could just put a shelf in my rack and zip it tight there, but I’m a bit OCD about the way it all looks.)

I do have an iStar D-118V2-ITX 1U chassis laying around that I might be able repurpose to house a new Quicksync Emby server build. It was my original pfSense build based on the pfS_WAAAT i5-3470T / Intel VT1000 / 1U Rack Mount Firewall/Router build. I know that the i5-3470T that’s in it right now isn’t a very good Quicksync option, so I’d need to figure out what internals to use instead if I went that route.

In that case I would recommend following the OTiS build.