Enterprise

OCI Compute BM.GPU.H100.8 Brings 8 NVIDIA H100 GPUs to the Cloud

Oracle Cloud Infrastructure (OCI) has launched a new bare metal compute shape that packages eight NVIDIA H100 GPUs, twin Intel 56-core Xeon CPUs, 2TB of DDR5, 16x NVMe SSDs, and 400Gb networking into an AI dream in the cloud. OCI Compute BM.GPU.H100.8 is generally available now.

Oracle Cloud Infrastructure (OCI) has launched a new bare metal compute shape that packages eight NVIDIA H100 GPUs, twin Intel 56-core Xeon CPUs, 2TB of DDR5, 16x NVMe SSDs, and 400Gb networking into an AI dream in the cloud. OCI Compute BM.GPU.H100.8 is generally available now.

The new OCI Compute BM.GPU.H100.8 shapes essentially leverage Oracle’s vast bare metal cloud expertise to deliver a cloud version of the highly dense 8-way H100 GPU servers often found on-prem. But where something like the Dell PowerEdge XE9680 might take a little time to deliver and hits as CAPEX, OCI Compute BM.GPU.H100.8 can be made more immediately available and follows the traditional cloud OPEX model.

OCI Compute BM.GPU.H100.8

Component Specifications
CPU 4th Gen Intel Xeon processors, 2x 56 Cores
GPU 8x NVIDIA H100 80GB Tensor Core
Memory 2TB DDR5
Local Storage 16x 3.84 TB NVMe
Cluster Networking 8x 400 Gb/sec

The OCI Compute BM.GPU.H100.8 specs more or less model the on-prem versions of these powerful GPU servers, albeit with twice as many SSDs (though low capacity) typically found on servers like this. Oracle has also indicated it plans to offer the new NVIDIA L40S GPUs in shapes that are coming in early 2024. The BM.L40S.4 shape will include four L40S GPUs with twin Intel Xeon 56-core CPUs, 1TB of memory, 15.36TB of NVMe storage and 400GB/s of network bandwidth.

While many organizations will make due just fine with a single one of these instances, OCI Supercluster allows them to scale from a single node up to 50,000 H100 GPUs. This option will be available later this year in the London and Chicago regions, with more to come in the future.

OCI AI Infrastructure

Engage with StorageReview

Newsletter | YouTube | Podcast iTunes/Spotify | Instagram | Twitter | TikTok | RSS Feed 

Brian Beeler

Brian is located in Cincinnati, Ohio and is the chief analyst and President of StorageReview.com.

Recent Posts

Pure Storage Unveils Advanced SLAs for Enhanced Cyber Recovery, Optimization, and Site Rebalance

Pure Storage has introduced three advanced Storage-as-a-Service (STaaS) service-level agreements (SLAs) designed to empower organizations by guaranteeing outcomes and reducing…

1 day ago

Pure Storage Showcases New AI Capabilities at //Accelerate 2024

Pure Storage announced a series of capabilities to transform how IT and business leaders enhance their AI deployment, bolster cyber…

1 day ago

HPE Virtualization Capability for HPE Private Cloud Makes HPE GreenLake the Future-Proof Hybrid Cloud Destination

More than 70% of enterprises are turning to hybrid cloud to drive business innovation and achieve greater operational efficiency and…

2 days ago

Hewlett Packard Enterprise and NVIDIA Announce Co-Developed AI Solutions

Hewlett Packard Enterprise (HPE) and NVIDIA have introduced NVIDIA AI Computing by HPE, a portfolio of co-developed AI solutions designed…

2 days ago

Leaders and Innovators in EUC – AWS and The Modern Desktop

AWS was one of the pioneers in desktop and applications as a service (DaaS and AAAS), and it is hard…

1 week ago

Western Digital Introduces New 64TB SSD, 32TB HDD for the AI Data Cycle

Fueling the next wave of AI innovation, Western Digital introduced a six-stage AI Data Cycle framework that defines the optimal…

1 week ago