---
description: NVIDIA has made a significant leap in AI computing by introducing the NVIDIA HGX H200. Based on the NVIDIA Hopper architecture, this new platform features...
title: NVIDIA Introduces HGX H200, Supercharges Hopper
image: https://www.storagereview.com/wp-content/uploads/2023/11/storagereview-NVIDIA-Hopper.jpg
---
[![Storage Review]()](https://storagereview.com/)
---
[Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)
[Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)
[![StorageReview.com]()](https://www.storagereview.com)
≡ Menu
- [Home](https://www.storagereview.com/)
- [Storage Reviews](https://www.storagereview.com/review)
- [End User Reviews](https://www.storagereview.com/consumer)
- [Enterprise Reviews](https://www.storagereview.com/enterprise)
- [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews)
- [SR Merch](https://store.storagereview.com)
- [Leaderboards](https://www.storagereview.com/best)
- [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays)
- [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds)
- [Best Servers](https://www.storagereview.com/best/servers)
- [Best Enterprise GPUs](https://www.storagereview.com/best/enterprise-gpus)
- [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai)
- [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai)
- [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools)
- [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware)
- [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives)
- [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds)
- [Best Business Laptops](https://www.storagereview.com/best/business-laptops)
- [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations)
- [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations)
- [Best Mini PCs](https://www.storagereview.com/best/mini-pcs)
- [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life)
- [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide)
- [About SR](https://www.storagereview.com/about-storagereview)
- [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations)
Search
[Home](https://www.storagereview.com/) » [News](https://www.storagereview.com/news) » NVIDIA Introduces HGX H200, Supercharges Hopper
# NVIDIA Introduces HGX H200, Supercharges Hopper
by Jordan Ranous on November 14, 2023
[AI](https://www.storagereview.com/enterprise/ai) ◇ [Enterprise](https://www.storagereview.com/enterprise)
NVIDIA has made a significant leap in AI computing by introducing the NVIDIA HGX H200. Based on the NVIDIA Hopper architecture, this new platform features the NVIDIA H200 Tensor Core GPU, tailored for generative AI and high-performance computing (HPC) workloads, handling massive data volumes with advanced memory capabilities.
![]()
The H200 stands out as the first GPU to incorporate high bandwidth (HBM3e )memory, offering faster and larger memory crucial for generative AI and large language models (LLMs) and advancing scientific computing for HPC workloads. It boasts 141GB of memory at a speed of 4.8 terabytes per second, nearly doubling the capacity and offering 2.4 times more bandwidth than its predecessor, the NVIDIA A100.
Systems powered by H200 from top server manufacturers and cloud service providers are expected to start shipping in the second quarter of 2024. Ian Buck, NVIDIA’s Vice President of Hyperscale and HPC, emphasizes that the H200 will significantly enhance the processing of vast data amounts at high speeds, which is essential for generative AI and HPC applications.
The Hopper architecture marks a notable performance improvement over previous generations, further enhanced by ongoing software updates like the recent release of [NVIDIA TensorRT-LLM](https://developer.nvidia.com/tensorrt). The H200 promises to nearly double inference speed on large language models like Llama 2, with more performance enhancements anticipated in future software updates.
## H200 Specifications
| NVIDIA H200 Tensor Core GPU | |
| --- | --- |
| Form Factor | H200 SXM |
| FP64 | 34 TFLOPS |
| FP64 Tensor Core | 67 TFLOPS |
| FP32 | 67 TFLOPS |
| TF32 Tensor Core | 989 TFLOPS |
| BFLOAT16 Tensor Core | 1,979 TFLOPS |
| FP16 Tensor Core | 1,979 TFLOPS |
| FP8 Tensor Core | 3,958 TFLOPS |
| INT8 Tensor Core | 3,958 TFLOPS |
| GPU Memory | 141GB |
| GPU Memory Bandwidth | 4.8TB/s |
| Decoders | 7 NVDEC
7 JPEG |
| Max Thermal Design Power (TDP) | Up to 700W (configurable) |
| Multi-Instance GPUs | Up to 7 MIGs @16.5GB each |
| Interconnect | NVIDIA NVLink: 900GB/s
PCIe Gen5: 128GB/s |
| Server Options | NVIDIA HGX H200 partner and NVIDIA-Certified Systems with 4 or 8 GPUs |
## Adaptable Form Factors
NVIDIA H200 will be available in various form factors, including NVIDIA HGX H200 server boards in four- and eight-way configurations, compatible with HGX H100 systems. It’s also available in the [NVIDIA GH200 Grace Hopper Superchip with HBM3e](https://nvidianews.nvidia.com/news/gh200-grace-hopper-superchip-with-hbm3e-memory). We recently posted a piece on the [NVIDIA GH200 Grace Hopper Supperchip](https://www.storagereview.com/news/nvidia-dgx-gh200-a-game-changer-for-generative-ai). These options ensure H200’s adaptability across different data center types, including on-premises, cloud, hybrid-cloud, and edge environments.
Key server makers and cloud service providers, including Amazon Web Services, Google Cloud, Microsoft Azure, and Oracle Cloud Infrastructure, are set to deploy H200-based instances starting next year.
The HGX H200, equipped with NVIDIA NVLink and NVSwitch high-speed interconnects, delivers top performance for various workloads, including training and inference for models beyond 175 billion parameters. An eight-way HGX H200 configuration provides over 32 petaflops of FP8 deep learning compute and 1.1TB of high-bandwidth memory, ideal for generative AI and HPC application combined with NVIDIA Grace CPUs and the NVLink-C2C interconnect, the H200 forms the GH200 Grace Hopper Superchip with HBM3e, a module designed for large-scale HPC and AI applications.
NVIDIA’s full-stack software support, including the [NVIDIA AI Enterprise suite](https://www.nvidia.com/en-us/data-center/products/ai-enterprise/), enables developers and enterprises to build and accelerate AI to HPC applications. The NVIDIA H200 is set to be available from global system manufacturers and cloud service providers starting in the second quarter of 2024, marking a new era in AI and HPC capabilities.
**Engage with StorageReview**
[Newsletter](https://www.storagereview.com/storage_newsletter) | [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") | [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") | [Twitter](https://twitter.com/storagereview "Opens in a new window") | [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") | [RSS Feed](https://www.storagereview.com/rss.xml)
![]()
### Jordan Ranous
AI Specialist; navigating you through the world of Enterprise AI. Writer and Analyst for Storage Review, coming from a background of Financial Big Data Analytics, Datacenter Ops/DevOps, and CX Analytics. Pilot, Astrophotographer, LTO Tape Guru, and Battery/Solar Enthusiast.
Previous post: [ASRock Rack Servers Support NVIDIA H200 GPUs and GH200 Superchips, Showcases AI and HPC Platforms](https://www.storagereview.com/news/asrock-rack-servers-support-nvidia-h200-gpus-and-gh200-superchips-showcases-ai-and-hpc-platforms)
Next post: [NVIDIA GH200 Grace Hopper Superchip Gains Massive Adoption](https://www.storagereview.com/news/nvidia-expanding-gh200-reach)
Trusted Vendors
Products and solutions from our affiliate partners:
- [
![Ubiquiti Logo]()
Ubiquiti
](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window")
- [
![Newegg Logo]()
Newegg
](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window")
- [
![Amazon Logo]() Amazon
](https://amzn.to/4fLJUEW "Opens in a new window")
Newsletter
Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam!
1
Leave this field empty if you’re human:
## Advertisement
Content Categories
[Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)
Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved.
Manage your privacy
To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen.
Functional Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
Statistics
Marketing
Features
Always active
Special features
Special purposes
Always active
- Manage options
- Manage services
- Manage {vendor\_count} vendors
- [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/)
Accept Deny Manage options Save preferences Manage options
- {title}
- {title}
- {title}
Manage your privacy
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
Statistics
Marketing
Features
Always active
Special features
Special purposes
Always active
- Manage options
- Manage services
- Manage {vendor\_count} vendors
- [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/)
Accept Deny Manage options Save preferences Manage options
- {title}
- {title}
- {title}
Manage consent Manage consent
```json
{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/news\/nvidia-introduces-hgx-h200-supercharges-hopper","url":"https:\/\/www.storagereview.com\/news\/nvidia-introduces-hgx-h200-supercharges-hopper","name":"NVIDIA Introduces HGX H200, Supercharges Hopper - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-introduces-hgx-h200-supercharges-hopper#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-introduces-hgx-h200-supercharges-hopper#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/11\/storagereview-NVIDIA-Hopper.jpg","datePublished":"2023-11-14T22:15:31+00:00","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-introduces-hgx-h200-supercharges-hopper#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/news\/nvidia-introduces-hgx-h200-supercharges-hopper"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/news\/nvidia-introduces-hgx-h200-supercharges-hopper#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/11\/storagereview-NVIDIA-Hopper.jpg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/11\/storagereview-NVIDIA-Hopper.jpg","width":604,"height":571},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/news\/nvidia-introduces-hgx-h200-supercharges-hopper#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.storagereview.com\/news"},{"@type":"ListItem","position":3,"name":"NVIDIA Introduces HGX H200, Supercharges Hopper"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]}
```