Nvidia DGX-1 - 8x Volta HMB2 GPU NVLink Server
DGX-1 servers feature SXM2 Socket Volta GPUs cards with 128GB or 256GB of total HBM2 memory, connected by an NVLink mesh network
Interconnect (NVLink): 300 GB/sec (V100 16GB/32GB)
Memory bandwidth: 900 GB/sec (V100 16GB/32GB)
Servers are tested and benchmarked by us prior to shipping, we do not include NVIDIA software but we update firmware to latest publicly available versions.
We ran Ubuntu 24.04 LTS and Proxmox VE with GPU passthrough in both cases being able to utilized the cards even inside the VMs (NVtop screenshot in product photos above)
There is BMC access with HTML5 KVM as well as monitoring (Screenshot attached)
We provide universal rack rails as an option for rack installation. (we could not find original)
We repaste the GPUs with premium direct to die thermal paste to ensure performance and longivity.
Your team should ensure the server is located in a cooled place and monitor temperatures to prevent overheating especially during intense jobs.
All models shipped from Nvidia were based on a dual socket configuration of Intel Xeon E5 CPUs, and are equipped with the following features. You may want to at least match them especially for the RAM.
- 512 GB of DDR4 ( To be selected)
- Dual 10Gb RJ45 networking ( already on board)
- 4 x 1.92 TB SSDs ( To be selected)
- 3200W of combined power supply capability (4x Hotswap PSUs already included)
- 3U Rackmount Chassis
Model | Socket | FP32 CUDA cores |
FP64 cores (excl. tensor) |
INT32 cores |
Boost clock |
Memory clock |
Memory bus width |
VRAM | Single precision (FP32) |
Double precision (FP64) |
INT8 (non-tensor) |
INT32 | FP16 | FP16 dense tensor |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
V100 16GB | SXM2 | 5120 | 2560 | 5120 | 1530 MHz | 1.75 Gbit/s HBM2 | 4096-bit | 16 GB HBM2 | 15.7 TFLOPS | 7.8 TFLOPS | 62 TOPS | 15.7 TOPS | 31.4 TFLOPS | 125 TFLOPS |
V100 32GB | SXM2 | 5120 | 2560 | 5120 | 1530 MHz | 1.75 Gbit/s HBM2 | 4096-bit | 32 GB HBM2 | 15.7 TFLOPS | 7.8 TFLOPS | 62 TOPS | 15.7 TOPS | 31.4 TFLOPS | 125 TFLOPS |