Home Enterprise ASRock Rack Unveils Powerful AI training Systems With NVIDIA HGX H100/H200 8-GPU Support

ASRock Rack Unveils Powerful AI training Systems With NVIDIA HGX H100/H200 8-GPU Support

by Lyle Smith

ASRock Rack took advantage of the NVIDIA GTC 2024 event to unveil its new AI training systems, the 6U8X-EGS2 H100 and 6U8X-EGS2 H200.

ASRock Rack took advantage of the NVIDIA GTC 2024 event to unveil its new AI training systems, the 6U8X-EGS2 H100 and 6U8X-EGS2 H200. This new line is the company’s most potent AI training system yet, capable of accommodating NVIDIA HGX H100 and HGX H200 8-GPUs. They are further enhanced with twelve PCIe Gen5 NVMe drive bays, multiple PCIe 5.0 x16 slots, and a robust 4+4 power supply unit for full redundancy; ASRock Rack’s new offerings are designed for efficiency and peak operation.

These servers are built specifically for the rigorous demands of generative AI applications, accelerating large language models, and supporting data analytics and high-performance computing workloads. This aligns with the announcement of NVIDIA’s new Blackwell platform, with ASRock Rack poised to contribute a wide range of server hardware products to support this new generation of computing.

The 4UMGX dual-socket barebone server, which can support up to eight NVIDIA H100 NVL or H200 GPUs in addition to six NVIDIA BlueField-3 DPUs or NVIDIA ConnectX-7 NICs, was also featured at the ASRock Rack booth. This 4U rackmount server is poised to incorporate the NVIDIA Blackwell architecture-powered GPUs, showcasing ASRock Rack’s readiness for NVIDIA’s latest technologies.

Emphasizing flexibility in design, the 4UMGX server uses the NVIDIA MGX modular reference design, enabling customization for varied use cases, streamlining development resources, and ensuring expedited market delivery. ASRock Rack has also indicated that its servers like the 4U8G-EGS2, 4U10G-GENOA2, 4U10G-EGS2, and the 4U8G-GENOA2, which currently support NVIDIA H100 NVL and NVIDIA H200 NVL GPUs, will soon receive updates to support the NVIDIA Blackwell architecture.

Those attending GTC had the opportunity to experience the MECAI-GH200, a 2U MGX server regarded as the most compact platform that supports the NVIDIA GH200 Grace Hopper Superchip, ideal for edge AI applications. With adjustments for an even more compact form factor and advanced networking capabilities, the MECAI-GH200 stands out for deployments in space-constrained environments with stringent connectivity requirements.

ASRock 6U8X-EGS2 H100 Specifications

 System
Form Factor 6U Rackmount
Dimensions 930 x 448 x 264.7mm (36.6” x 17.6” x 10.4”)
Support MB SP2C741D32G-2L+
 Front Panel
Buttons Power button w/ LED, Reset button, NMI button, UID button
LEDs System fault LED, HDD activity LED
I/O Ports 2 RJ45 (1GbE) by Intel i350, shares with Rear IO
1 dedicated IPMI, shares with Rear IO
4 Type-A (USB3.2 Gen1)
1 DB15 (VGA)
 External Drive Bay / Storage
Front Side Drive Bay 8 Hot-swap 2.5″ NVMe (PCIe5.0 x4) drive bays, 4 Hot-swap 2.5″ NVMe (PCIe5.0 x4)/SATA drive bays
Internal Side 1 M-key (PCIe3.0 x4 or SATA 6Gb/s), supports 2280/22110 form factor [PCH]
1 M-key (PCIe3.0 x4), supports 2280/22110 form factor [PCH]
 Power Supply
Type 4+4 CRPS
Output Watts 3002.4W @ 220-240Vac input, 2900W @200-220Vac input, 1250W @100-127Vac input
Efficiency 80-PLUS Platinum/Titanium
AC Input Low-line: 100-127Vrms, 50/60Hz ; High-line: 200-240Vrms, 50/60Hz
 System Fan
Fan 21 PWM Hot-swap 80×80 mm fans
 Processor System
CPU Supports 5th and 4th Gen Intel Xeon Scalable Processors
Socket Dual Socket E (LGA 4677)
Thermal Design Power Up to 350W
Chipset C741
 System Memory
Supported DIMM Quantity 16+16 DIMM slots (2DPC)
Supported Type Supports DDR5 288-pin RDIMM, RDIMM-3DS
Max. Capacity per DIMM RDIMM: 96GB (2R)
RDIMM-3DS: 512GB (2S8Rx4)
Max. DIMM Frequency 5600 MT/s (1DPC) / 4400 MT/s (2DPC) on 5th Gen Intel Xeon Scalable Processors
4800 MT/s (1DPC) / 4400 MT/s (2DPC) on 4th Gen Intel Xeon Scalable Processors
*Memory speed and capacity support varies by CPU SKU
Voltage 1.1V
 PCIe Expansion Slots (SLOT7 close to CPU)
PCIe x 16 Rear:
8 HHHL PCIe5.0 x16
5 FHHL PCIe5.0 x16
 Ethernet
Additional GbE Controller Intel i350: 2 RJ45 (1GbE)
 Server Management
BMC Controller ASPEED AST2600
IPMI Dedicated GLAN 1 Realtek RTL8211F for dedicated management GLAN
 Graphics
Controller ASPEED AST2600
VRAM DDR4 512MB
 Rear I/O
UID Button/LED 1 UID button
VGA Port 1 DB15 (VGA)
USB 3.2 Gen1 Port 2 Type-A (USB3.2 Gen1)
RJ45 2 RJ45 (1GbE) by Intel i350, shares with Front Panel
1 dedicated IPMI, shares with Front Panel

ASRock 6U8X-EGS2 H200 Specifications

 System
Form Factor 6U Rackmount
Dimensions 930 x 448 x 264.7mm (36.6” x 17.6” x 10.4”)
Support MB SP2C741D32G-2L+
 Front Panel
Buttons Power button w/ LED, Reset button, NMI button, UID button
LEDs System fault LED, HDD activity LED
I/O Ports 2 RJ45 (1GbE) by Intel i350, shares with Rear IO
1 dedicated IPMI, shares with Rear IO
4 Type-A (USB3.2 Gen1)
1 DB15 (VGA)
 External Drive Bay / Storage
Front Side Drive Bay 8 Hot-swap 2.5″ NVMe (PCIe5.0 x4) drive bays, 4 Hot-swap 2.5″ NVMe (PCIe5.0 x4)/SATA drive bays
Internal Side 1 M-key (PCIe3.0 x4 or SATA 6Gb/s), supports 2280/22110 form factor [PCH]
1 M-key (PCIe3.0 x4), supports 2280/22110 form factor [PCH]
 Power Supply
Type 4+4 CRPS
Output Watts 3002.4W @ 220-240Vac input, 2900W @200-220Vac input, 1250W @100-127Vac input
Efficiency 80-PLUS Platinum/Titanium
AC Input Low-line: 100-127Vrms, 50/60Hz ; High-line: 200-240Vrms, 50/60Hz
 System Fan
Fan 21 PWM Hot-swap 80×80 mm fans
 Processor System
CPU Supports 5th and 4th Gen Intel Xeon Scalable Processors
Socket Dual Socket E (LGA 4677)
Thermal Design Power Up to 350W
Chipset C741
 System Memory
Supported DIMM Quantity 16+16 DIMM slots (2DPC)
Supported Type Supports DDR5 288-pin RDIMM, RDIMM-3DS
Max. Capacity per DIMM RDIMM: 96GB (2R)
RDIMM-3DS: 512GB (2S8Rx4)
Max. DIMM Frequency 5600 MT/s (1DPC) / 4400 MT/s (2DPC) on 5th Gen Intel Xeon Scalable Processors
4800 MT/s (1DPC) / 4400 MT/s (2DPC) on 4th Gen Intel Xeon Scalable Processors
*Memory speed and capacity support varies by CPU SKU
Voltage 1.1V
 PCIe Expansion Slots (SLOT7 close to CPU)
PCIe x 16 Rear:
8 HHHL PCIe5.0 x16
5 FHHL PCIe5.0 x16
 Ethernet
Additional GbE Controller Intel i350: 2 RJ45 (1GbE)
 Server Management
BMC Controller ASPEED AST2600
IPMI Dedicated GLAN 1 Realtek RTL8211F for dedicated management GLAN
 Graphics
Controller ASPEED AST2600
VRAM DDR4 512MB
 Rear I/O
UID Button/LED 1 UID button
VGA Port 1 DB15 (VGA)
USB 3.2 Gen1 Port 2 Type-A (USB3.2 Gen1)
RJ45 2 RJ45 (1GbE) by Intel i350, shares with Front Panel
1 dedicated IPMI, shares with Front Panel
 Hardware Monitor
Temperature CPU, MB, Card side Temperature Sensing
Fan Fan Tachometer
CPU Quiet Fan (Allow Chassis Fan Speed Auto-Adjust)

ASRock 6U8X-EGS2 H200

ASRock 6U8X-EGS2 H100

Engage with StorageReview

Newsletter | YouTube | Podcast iTunes/Spotify | Instagram | Twitter | TikTok | RSS Feed