---
description: NVIDIA has made quite a splash in the world of artificial intelligence (AI) and high-performance computing with its latest unveiling – the NVIDIA GH200...
title: NVIDIA Grace Hopper Superchip Dominates MLPerf Inference Benchmarks
image: https://www.storagereview.com/wp-content/uploads/2023/03/SR-NVIDIA-GTC-L4.png
---

[![Storage Review]()](https://storagereview.com/)

---

[Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)

[Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)

[![StorageReview.com]()](https://www.storagereview.com)

≡ Menu

- [Home](https://www.storagereview.com/)
- [Storage Reviews](https://www.storagereview.com/review)
  - [End User Reviews](https://www.storagereview.com/consumer)
  - [Enterprise Reviews](https://www.storagereview.com/enterprise)
  - [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews)
- [SR Merch](https://store.storagereview.com)
- [Leaderboards](https://www.storagereview.com/best)
  - [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays)
  - [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds)
  - [Best Servers](https://www.storagereview.com/best/servers)
  - [Best Enterprise GPUs](https://www.storagereview.com/best/enterprise-gpus)
  - [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai)
  - [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai)
  - [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools)
  - [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware)
  - [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives)
  - [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds)
  - [Best Business Laptops](https://www.storagereview.com/best/business-laptops)
  - [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations)
  - [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations)
  - [Best Mini PCs](https://www.storagereview.com/best/mini-pcs)
  - [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life)
- [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide)
- [About SR](https://www.storagereview.com/about-storagereview)
  - [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations)

Search

[Home](https://www.storagereview.com/) » [News](https://www.storagereview.com/news) » NVIDIA Grace Hopper Superchip Dominates MLPerf Inference Benchmarks

# NVIDIA Grace Hopper Superchip Dominates MLPerf Inference Benchmarks

by Jordan Ranous on September 11, 2023

[AI](https://www.storagereview.com/enterprise/ai)  ◇  [Enterprise](https://www.storagereview.com/enterprise)

NVIDIA has made quite a splash in the world of artificial intelligence (AI) and high-performance computing with its latest unveiling – the NVIDIA GH200 Grace Hopper Superchip. This recent offering has shown outstanding performance in the MLPerf benchmarks, demonstrating NVIDIA’s prowess in cloud and edge AI.

![NVIDIA Grace Hopper Super Chip]()

## A Superchip that Speaks Volumes

The GH200 Superchip is not just any ordinary chip. It uniquely combines a Hopper GPU with a Grace CPU, providing heightened memory, bandwidth, and the capability to auto-adjust power between the CPU and GPU for peak performance. This innovative integration lets the chip achieve a delicate balance between power and performance, ensuring that AI applications get the resources they need when they need them.

## Exceptional MLPerf Results

MLPerf benchmarks are a respected industry standard, and NVIDIA’s GH200 didn’t disappoint. Not only did the superchip run all the data center inference tests, but it also showcased the versatility of NVIDIA’s AI platform, extending its scope from cloud operations to the edges of the network.

Moreover, NVIDIA’s H100 GPUs weren’t left behind either. The HGX H100 systems, equipped with eight H100 GPUs, showcased superior throughput across all the MLPerf Inference tests. This highlights the immense potential and capabilities of the H100 GPUs, especially for tasks such as computer vision, speech recognition, medical imaging, recommendation systems, and large language models (LLMs).

## TensorRT-LLM: Amplifying Inference Performance

![]()

NVIDIA has always been at the forefront of continuous innovation, and the [TensorRT-LLM](https://www.storagereview.com/news/nvidia-tensorrt-llm-accelerates-large-language-model-inference-on-nvidia-h100-gpus) is a testament to this legacy. This generative AI software boosts inference and comes as an open-source library. Even though it wasn’t submitted to MLPerf in time for the August evaluation, it holds promise, allowing users to amplify the performance of their H100 GPUs without incurring additional costs. Partners like Meta, Cohere, and Grammarly have benefitted from NVIDIA’s efforts in enhancing LLM inference, reaffirming the importance of such software developments in the AI realm.

## L4 GPUs: Bridging Mainstream Servers and Performance

![]()

[With the latest MLPerf benchmarks](https://www.nvidia.com/en-us/data-center/resources/mlperf-benchmarks/), the L4 GPUs have exhibited commendable performance across a myriad of workloads. These GPUs, when placed in compact accelerators, have demonstrated performance metrics up to six times more efficient than CPUs with higher power ratings. The introduction of dedicated media engines, in collaboration with CUDA software, gives the L4 GPU the edge, especially in computer vision tasks.

## Pushing the Boundaries: Edge Computing and More

The advancements are not limited to cloud computing alone. NVIDIA’s focus on edge computing is evident with the Jetson Orin system-on-module, which showcases performance enhancements of up to 84% compared to its previous versions in object detection.

## MLPerf: A Transparent Benchmarking Standard

MLPerf continues to be an objective benchmark that users across the globe rely on for making purchase decisions. The inclusion of cloud service giants like Microsoft Azure and Oracle Cloud Infrastructure, along with renowned system manufacturers like Dell, Lenovo, and Supermicro, underlines the significance of MLPerf in the industry.

In conclusion, NVIDIA’s recent performance in the MLPerf benchmarks reinforces its leadership position in the AI sector. With a broad ecosystem, continuous software innovation, and a commitment to delivering high-quality performance, NVIDIA is indeed shaping the future of AI.

For a more in-depth technical dive into NVIDIA’s accomplishments, refer to the linked [technical blog](https://developer.nvidia.com/blog/). Those keen on replicating NVIDIA’s benchmarking success can access the software from the [MLPerf repository](https://github.com/mlcommons/inference) and the [NVIDIA NGC software hub](https://www.nvidia.com/en-us/gpu-cloud/).

**Engage with StorageReview**

[Newsletter](https://www.storagereview.com/storage_newsletter) |  [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast  [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") |  [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") |  [Twitter](https://twitter.com/storagereview "Opens in a new window") |  [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") |  [RSS Feed](https://www.storagereview.com/rss.xml)

![]()

### Jordan Ranous

AI Specialist; navigating you through the world of Enterprise AI. Writer and Analyst for Storage Review, coming from a background of Financial Big Data Analytics, Datacenter Ops/DevOps, and CX Analytics. Pilot, Astrophotographer, LTO Tape Guru, and Battery/Solar Enthusiast.

Previous post: [Habana Gaudi2 AI Accelerators Outperforms NVIDIA H100 on BridgeTower Models](https://www.storagereview.com/news/habana-gaudi2-ai-accelerators-outperforms-nvidia-h100-on-bridgetower-models)

Next post: [Intel Unveils Thunderbolt 5](https://www.storagereview.com/news/intel-unveils-thunderbolt-5)

Trusted Vendors

Products and solutions from our affiliate partners:

- [  
  ![Ubiquiti Logo]()  
   Ubiquiti  
  ](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window")
- [  
  ![Newegg Logo]()  
   Newegg  
  ](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window")
- [  
  ![Amazon Logo]() Amazon  
  ](https://amzn.to/4fLJUEW "Opens in a new window")

Newsletter

Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam!

1  

Leave this field empty if you’re human:

## Advertisement

Content Categories

[Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)

Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved.

Manage your privacy

To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions.

Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen.

Functional Functional Always active

The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.

Preferences Preferences

The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.

Statistics Statistics

The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.

Marketing Marketing

The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.

Statistics

Marketing

Features

Always active

Special features

Special purposes

Always active

- Manage options
- Manage services
- Manage {vendor\_count} vendors
- [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/)

Accept Deny Manage options Save preferences Manage options

- {title}
- {title}
- {title}

Manage your privacy

To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.

Functional Functional Always active

The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.

Preferences Preferences

The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.

Statistics Statistics

The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.

Marketing Marketing

The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.

Statistics

Marketing

Features

Always active

Special features

Special purposes

Always active

- Manage options
- Manage services
- Manage {vendor\_count} vendors
- [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/)

Accept Deny Manage options Save preferences Manage options

- {title}
- {title}
- {title}

Manage consent Manage consent

```json
{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/news\/nvidia-grace-hopper-superchip-dominates-mlperf-inference-benchmarks","url":"https:\/\/www.storagereview.com\/news\/nvidia-grace-hopper-superchip-dominates-mlperf-inference-benchmarks","name":"NVIDIA Grace Hopper Superchip Dominates MLPerf Inference Benchmarks - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-grace-hopper-superchip-dominates-mlperf-inference-benchmarks#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-grace-hopper-superchip-dominates-mlperf-inference-benchmarks#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/03\/SR-NVIDIA-GTC-L4.png","datePublished":"2023-09-12T00:36:01+00:00","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-grace-hopper-superchip-dominates-mlperf-inference-benchmarks#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/news\/nvidia-grace-hopper-superchip-dominates-mlperf-inference-benchmarks"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/news\/nvidia-grace-hopper-superchip-dominates-mlperf-inference-benchmarks#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/03\/SR-NVIDIA-GTC-L4.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/03\/SR-NVIDIA-GTC-L4.png","width":771,"height":390},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/news\/nvidia-grace-hopper-superchip-dominates-mlperf-inference-benchmarks#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.storagereview.com\/news"},{"@type":"ListItem","position":3,"name":"NVIDIA Grace Hopper Superchip Dominates MLPerf Inference Benchmarks"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]}
```
