Enterprise

ASRock Rack Unveils Powerful AI training Systems With NVIDIA HGX H100/H200 8-GPU Support

ASRock Rack took advantage of the NVIDIA GTC 2024 event to unveil its new AI training systems, the 6U8X-EGS2 H100 and 6U8X-EGS2 H200.

ASRock Rack took advantage of the NVIDIA GTC 2024 event to unveil its new AI training systems, the 6U8X-EGS2 H100 and 6U8X-EGS2 H200. This new line is the company’s most potent AI training system yet, capable of accommodating NVIDIA HGX H100 and HGX H200 8-GPUs. They are further enhanced with twelve PCIe Gen5 NVMe drive bays, multiple PCIe 5.0 x16 slots, and a robust 4+4 power supply unit for full redundancy; ASRock Rack’s new offerings are designed for efficiency and peak operation.

These servers are built specifically for the rigorous demands of generative AI applications, accelerating large language models, and supporting data analytics and high-performance computing workloads. This aligns with the announcement of NVIDIA’s new Blackwell platform, with ASRock Rack poised to contribute a wide range of server hardware products to support this new generation of computing.

The 4UMGX dual-socket barebone server, which can support up to eight NVIDIA H100 NVL or H200 GPUs in addition to six NVIDIA BlueField-3 DPUs or NVIDIA ConnectX-7 NICs, was also featured at the ASRock Rack booth. This 4U rackmount server is poised to incorporate the NVIDIA Blackwell architecture-powered GPUs, showcasing ASRock Rack’s readiness for NVIDIA’s latest technologies.

Emphasizing flexibility in design, the 4UMGX server uses the NVIDIA MGX modular reference design, enabling customization for varied use cases, streamlining development resources, and ensuring expedited market delivery. ASRock Rack has also indicated that its servers like the 4U8G-EGS2, 4U10G-GENOA2, 4U10G-EGS2, and the 4U8G-GENOA2, which currently support NVIDIA H100 NVL and NVIDIA H200 NVL GPUs, will soon receive updates to support the NVIDIA Blackwell architecture.

Those attending GTC had the opportunity to experience the MECAI-GH200, a 2U MGX server regarded as the most compact platform that supports the NVIDIA GH200 Grace Hopper Superchip, ideal for edge AI applications. With adjustments for an even more compact form factor and advanced networking capabilities, the MECAI-GH200 stands out for deployments in space-constrained environments with stringent connectivity requirements.

ASRock 6U8X-EGS2 H100 Specifications

System
Form Factor 6U Rackmount
Dimensions 930 x 448 x 264.7mm (36.6” x 17.6” x 10.4”)
Support MB SP2C741D32G-2L+
Front Panel
Buttons Power button w/ LED, Reset button, NMI button, UID button
LEDs System fault LED, HDD activity LED
I/O Ports 2 RJ45 (1GbE) by Intel i350, shares with Rear IO
1 dedicated IPMI, shares with Rear IO
4 Type-A (USB3.2 Gen1)
1 DB15 (VGA)
External Drive Bay / Storage
Front Side Drive Bay 8 Hot-swap 2.5″ NVMe (PCIe5.0 x4) drive bays, 4 Hot-swap 2.5″ NVMe (PCIe5.0 x4)/SATA drive bays
Internal Side 1 M-key (PCIe3.0 x4 or SATA 6Gb/s), supports 2280/22110 form factor [PCH]
1 M-key (PCIe3.0 x4), supports 2280/22110 form factor [PCH]
Power Supply
Type 4+4 CRPS
Output Watts 3002.4W @ 220-240Vac input, 2900W @200-220Vac input, 1250W @100-127Vac input
Efficiency 80-PLUS Platinum/Titanium
AC Input Low-line: 100-127Vrms, 50/60Hz ; High-line: 200-240Vrms, 50/60Hz
System Fan
Fan 21 PWM Hot-swap 80×80 mm fans
Processor System
CPU Supports 5th and 4th Gen Intel Xeon Scalable Processors
Socket Dual Socket E (LGA 4677)
Thermal Design Power Up to 350W
Chipset C741
System Memory
Supported DIMM Quantity 16+16 DIMM slots (2DPC)
Supported Type Supports DDR5 288-pin RDIMM, RDIMM-3DS
Max. Capacity per DIMM RDIMM: 96GB (2R)
RDIMM-3DS: 512GB (2S8Rx4)
Max. DIMM Frequency 5600 MT/s (1DPC) / 4400 MT/s (2DPC) on 5th Gen Intel Xeon Scalable Processors
4800 MT/s (1DPC) / 4400 MT/s (2DPC) on 4th Gen Intel Xeon Scalable Processors
*Memory speed and capacity support varies by CPU SKU
Voltage 1.1V
PCIe Expansion Slots (SLOT7 close to CPU)
PCIe x 16 Rear:
8 HHHL PCIe5.0 x16
5 FHHL PCIe5.0 x16
Ethernet
Additional GbE Controller Intel i350: 2 RJ45 (1GbE)
Server Management
BMC Controller ASPEED AST2600
IPMI Dedicated GLAN 1 Realtek RTL8211F for dedicated management GLAN
Graphics
Controller ASPEED AST2600
VRAM DDR4 512MB
Rear I/O
UID Button/LED 1 UID button
VGA Port 1 DB15 (VGA)
USB 3.2 Gen1 Port 2 Type-A (USB3.2 Gen1)
RJ45 2 RJ45 (1GbE) by Intel i350, shares with Front Panel
1 dedicated IPMI, shares with Front Panel

ASRock 6U8X-EGS2 H200 Specifications

System
Form Factor 6U Rackmount
Dimensions 930 x 448 x 264.7mm (36.6” x 17.6” x 10.4”)
Support MB SP2C741D32G-2L+
Front Panel
Buttons Power button w/ LED, Reset button, NMI button, UID button
LEDs System fault LED, HDD activity LED
I/O Ports 2 RJ45 (1GbE) by Intel i350, shares with Rear IO
1 dedicated IPMI, shares with Rear IO
4 Type-A (USB3.2 Gen1)
1 DB15 (VGA)
External Drive Bay / Storage
Front Side Drive Bay 8 Hot-swap 2.5″ NVMe (PCIe5.0 x4) drive bays, 4 Hot-swap 2.5″ NVMe (PCIe5.0 x4)/SATA drive bays
Internal Side 1 M-key (PCIe3.0 x4 or SATA 6Gb/s), supports 2280/22110 form factor [PCH]
1 M-key (PCIe3.0 x4), supports 2280/22110 form factor [PCH]
Power Supply
Type 4+4 CRPS
Output Watts 3002.4W @ 220-240Vac input, 2900W @200-220Vac input, 1250W @100-127Vac input
Efficiency 80-PLUS Platinum/Titanium
AC Input Low-line: 100-127Vrms, 50/60Hz ; High-line: 200-240Vrms, 50/60Hz
System Fan
Fan 21 PWM Hot-swap 80×80 mm fans
Processor System
CPU Supports 5th and 4th Gen Intel Xeon Scalable Processors
Socket Dual Socket E (LGA 4677)
Thermal Design Power Up to 350W
Chipset C741
System Memory
Supported DIMM Quantity 16+16 DIMM slots (2DPC)
Supported Type Supports DDR5 288-pin RDIMM, RDIMM-3DS
Max. Capacity per DIMM RDIMM: 96GB (2R)
RDIMM-3DS: 512GB (2S8Rx4)
Max. DIMM Frequency 5600 MT/s (1DPC) / 4400 MT/s (2DPC) on 5th Gen Intel Xeon Scalable Processors
4800 MT/s (1DPC) / 4400 MT/s (2DPC) on 4th Gen Intel Xeon Scalable Processors
*Memory speed and capacity support varies by CPU SKU
Voltage 1.1V
PCIe Expansion Slots (SLOT7 close to CPU)
PCIe x 16 Rear:
8 HHHL PCIe5.0 x16
5 FHHL PCIe5.0 x16
Ethernet
Additional GbE Controller Intel i350: 2 RJ45 (1GbE)
Server Management
BMC Controller ASPEED AST2600
IPMI Dedicated GLAN 1 Realtek RTL8211F for dedicated management GLAN
Graphics
Controller ASPEED AST2600
VRAM DDR4 512MB
Rear I/O
UID Button/LED 1 UID button
VGA Port 1 DB15 (VGA)
USB 3.2 Gen1 Port 2 Type-A (USB3.2 Gen1)
RJ45 2 RJ45 (1GbE) by Intel i350, shares with Front Panel
1 dedicated IPMI, shares with Front Panel
Hardware Monitor
Temperature CPU, MB, Card side Temperature Sensing
Fan Fan Tachometer
CPU Quiet Fan (Allow Chassis Fan Speed Auto-Adjust)

ASRock 6U8X-EGS2 H200

ASRock 6U8X-EGS2 H100

Engage with StorageReview

Newsletter | YouTube | Podcast iTunes/Spotify | Instagram | Twitter | TikTok | RSS Feed 

Lyle Smith

Lyle is a staff writer for StorageReview, covering a broad set of end user and enterprise IT topics.

Recent Posts

JetCool Unveils Cold Plates for the NVIDIA H100 GPU

JetCool has launched an innovative liquid cooling module tailored for NVIDIA's H100 SXM and PCIe GPUs, claiming a significant advancement…

1 day ago

iXsystems Expands TrueNAS Enterprise with H-Series Platforms

iXsystems has launched the TrueNAS Enterprise H-Series platforms, designed to give organizations ultimate performance. The H10 model is now available,…

5 days ago

Microsoft Azure Edge Infrastructure At Hannover Messe 2024

Hannover Messe 2024 represents a significant event in the global industrial sector, serving as the world's largest industrial trade fair.…

5 days ago

IBM Storage Assurance Program Provides Purchase Protection and Flexibility

The IBM Storage Assurance program offers access to the latest FlashSystem hardware and software, supporting investment protection from day one.…

5 days ago

Proxmox Backup Server 3.2 Adds Advanced Notification System and Automated Installations

Proxmox Backup Server 3.2 has been released - open-source solution designed for backup of VMs, containers, and physical hosts. (more…)

6 days ago

IBM FlashSystem 5300 Entry All-Flash Array Launched

IBM has unveiled the FlashSystem 5300, setting a new standard for entry-level all-flash storage systems by providing impressive performance, high…

6 days ago