(v2) Still 4 GPU in same case, but platform changed.
(v2) Special treatment to route the front panel pins.
(v2) Temperature from thermal camera.
(v2) Board view (buttons in the middle).
(v1) back view.
(v1) side view.
(v1) back view.
(v1) Angled adapter is used.
(v1) RAM sticks and power buttons.
(v1) Power consumption (up to 1200W).
(v2) Finetune in progress (nvtop).
(v2) Finetune in progress (btop).
(v1) BIOS screen.
Small 4x RTX 3090 AI Training rig (v2)
V2 update: See build logs.
tldr: This is a dedicated setup to finetune Stable Diffusion XL. It barely runs with compromised setting. It is small in size, around mid tower ATX, insead of a mining rig.
How the parts are gathered
Mostly from Carousell / DCFever and offline deals. The listed parts are stripped from ebay / goofish (xianyu) for "proof of existance".
Part List with Details
CPU: Intel i9-7960X. It has 44 PCIe lanes (comparing to i7's 28) to support 4 GPUs and a U.2 drive.
Motherboard: EVGA X299 Dark. Besides 4 GPU slots, it has beefy external 6-pin PCIe power. The blower RTX 3090s will pull 50W from the PCIe slot, without external PCIe slot power, such as Supermicro C9X299-RPGF (it has on board display!), the power rail voltage drop to as low as 10.8V, causing PSU trip. With the external PCIe power, it has restored to 11.6V.
RAM1: Kingston FURY Beast DDR4 RGB 3200MT/s 64GB kit. A pair of 32GB stick from my current Miku RGB build.
RAM2: A pair of HEORIADY 32G sticks. It is instable in general, using a special stacked die "d9xqm" from Micron. It is a rare single side 32GB UDIMM.
GPU1: Zotac RTX 3090 OEM Blower "ZT-A30900A-10B". Originally released from goofish / xianyu, but I eventually obtained from a local deal. Condition was "looks good but overheat". Thermal paste / thermal pad refresh refresh solved the problem.
GPU2: Colourful RTX 3090 OEM Blower. Obtained from a local deal. Close to brandnew. Works fine. However the factory BIOS mod made the fan spins around 60% when idle, which is loud. Others are 30%.
GPU3: Manli RTX 3090 OEM Blower. Same deal with the Zotac, even the condition / PCB / BIOS mod are identical. Thermal paste / thermal pad refresh refresh solved the problem. Parent company of both brand is PCPartner?
GPU4: Gigabyte RTX 3090 Gaming OC, but modified with 3080 Turbo heatsink and become Gigabyte 3090 Turbo. It took me many hours to mod: Most capacitors are needed to swap, meanwhile many connectors are needed to be removed, even the BIOS switch needed to be shaved, and finally the BIOS swap.
SSD1: Intel / Solidigm DC P4510 3.84TB. Storing dataset and training results.
SSD2: Samsung PM863a 1.92TB. Storing WebUI, codes, and logs. Notice that it is SATA instead of U.2. My SSD may be fauly: It drops connection (may not offine) after hours of idle.
SSD3: Plextor M6 Pro 128GB. Just a random SSD for Linux OS. Storing training code, IDE and some notes.
PSU: "JL2000PG" 2000W mining PSU. Claimed "93% efficiency", comes with 8x 8+8pin powercords. I bought it brand new. I replaced the noisy fan with Corsiar NR135L. The PSU runs at 61C with 1200W loading (viewed via thermal camera).
Frame: Unbranded EATX aluminum open benchtable. I searched in Taobao for many pages, for 4 card support, which is no more common. Since it is sheet based instead of column based, it is still more expensive than a oridinary PC case. Common choice will be mining rig with server board, but I don't have space.
End of part list
Thank you very much for reading my lengthy part list and analysis till the very last! Also check out my AI WS build with many RAM!
tldr: This is a dedicated setup to finetune Stable Diffusion XL. It barely runs with compromised setting. It is small in size, around mid tower ATX, insead of a mining rig.
How the parts are gathered
Mostly from Carousell / DCFever and offline deals. The listed parts are stripped from ebay / goofish (xianyu) for "proof of existance".
Part List with Details
CPU: Intel i9-7960X. It has 44 PCIe lanes (comparing to i7's 28) to support 4 GPUs and a U.2 drive.
Motherboard: EVGA X299 Dark. Besides 4 GPU slots, it has beefy external 6-pin PCIe power. The blower RTX 3090s will pull 50W from the PCIe slot, without external PCIe slot power, such as Supermicro C9X299-RPGF (it has on board display!), the power rail voltage drop to as low as 10.8V, causing PSU trip. With the external PCIe power, it has restored to 11.6V.
RAM1: Kingston FURY Beast DDR4 RGB 3200MT/s 64GB kit. A pair of 32GB stick from my current Miku RGB build.
RAM2: A pair of HEORIADY 32G sticks. It is instable in general, using a special stacked die "d9xqm" from Micron. It is a rare single side 32GB UDIMM.
GPU1: Zotac RTX 3090 OEM Blower "ZT-A30900A-10B". Originally released from goofish / xianyu, but I eventually obtained from a local deal. Condition was "looks good but overheat". Thermal paste / thermal pad refresh refresh solved the problem.
GPU2: Colourful RTX 3090 OEM Blower. Obtained from a local deal. Close to brandnew. Works fine. However the factory BIOS mod made the fan spins around 60% when idle, which is loud. Others are 30%.
GPU3: Manli RTX 3090 OEM Blower. Same deal with the Zotac, even the condition / PCB / BIOS mod are identical. Thermal paste / thermal pad refresh refresh solved the problem. Parent company of both brand is PCPartner?
GPU4: Gigabyte RTX 3090 Gaming OC, but modified with 3080 Turbo heatsink and become Gigabyte 3090 Turbo. It took me many hours to mod: Most capacitors are needed to swap, meanwhile many connectors are needed to be removed, even the BIOS switch needed to be shaved, and finally the BIOS swap.
SSD1: Intel / Solidigm DC P4510 3.84TB. Storing dataset and training results.
SSD2: Samsung PM863a 1.92TB. Storing WebUI, codes, and logs. Notice that it is SATA instead of U.2. My SSD may be fauly: It drops connection (may not offine) after hours of idle.
SSD3: Plextor M6 Pro 128GB. Just a random SSD for Linux OS. Storing training code, IDE and some notes.
PSU: "JL2000PG" 2000W mining PSU. Claimed "93% efficiency", comes with 8x 8+8pin powercords. I bought it brand new. I replaced the noisy fan with Corsiar NR135L. The PSU runs at 61C with 1200W loading (viewed via thermal camera).
Frame: Unbranded EATX aluminum open benchtable. I searched in Taobao for many pages, for 4 card support, which is no more common. Since it is sheet based instead of column based, it is still more expensive than a oridinary PC case. Common choice will be mining rig with server board, but I don't have space.
End of part list
Thank you very much for reading my lengthy part list and analysis till the very last! Also check out my AI WS build with many RAM!
Color(s): Black
RGB Lighting? No
Theme: none
Cooling: Air Cooling
Size: ATX
Type: General Build
Build Updates
Massive change for full scale finetuning
Hardware
CPU
$ 347.48
Memory
$ 90.48
Graphics
PSU
$ 550.01
Case
Approved by: