---
description: NVIDIA’s first 7nm GPU is the NVIDIA A100. The A100 is based on NVIDIA’s Ampere architecture and contains 54 billion transistors.
title: NVIDIA A100 Announced At GTC 2020
image: https://www.storagereview.com/wp-content/uploads/2020/05/StorageReview-NVIDIA-DGX-A100-installed-at-Argonne-National-Laboratory-to-fight-COVID-19-Image-courtesy-Argonne-National-Laboratory.jpg
---

[![Storage Review]()](https://storagereview.com/)

---

[Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)

[Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)

[![StorageReview.com](https://www.storagereview.com/wp-content/uploads/2026/07/Storage-Review-2x.png)](https://www.storagereview.com)

≡ Menu

- [Home](https://www.storagereview.com/)
- [Storage Reviews](https://www.storagereview.com/review)
  - [End User Reviews](https://www.storagereview.com/consumer)
  - [Enterprise Reviews](https://www.storagereview.com/enterprise)
  - [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews)
- [SR Merch](https://store.storagereview.com)
- [Leaderboards](https://www.storagereview.com/best)
  - [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays)
  - [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds)
  - [Best Servers](https://www.storagereview.com/best/servers)
  - [Best Enterprise GPUs](https://www.storagereview.com/best/enterprise-gpus)
  - [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai)
  - [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai)
  - [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools)
  - [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware)
  - [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives)
  - [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds)
  - [Best Business Laptops](https://www.storagereview.com/best/business-laptops)
  - [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations)
  - [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations)
  - [Best Mini PCs](https://www.storagereview.com/best/mini-pcs)
  - [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life)
- [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide)
- [About SR](https://www.storagereview.com/about-storagereview)
  - [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations)

Search

[Home](https://www.storagereview.com/) » [News](https://www.storagereview.com/news) » NVIDIA A100 Announced At GTC 2020

# NVIDIA A100 Announced At GTC 2020

by Michael Rink on May 14, 2020

[Enterprise](https://www.storagereview.com/enterprise)  ◇  [Enterprise Storage](https://www.storagereview.com/enterprise/enterprise-storage)

Today, at the rescheduled GTC (GPU Technology Conference organized by NVIDIA), NVIDIA revealed that they have begun shipping their first 7nm GPU to appliance manufacturers. Much like AMD, who released a 7nm GPU two years ago in 2018, NVIDIA is choosing to focus on the data center use cases for their first 7nm GPU. NVIDIA has been emphasizing developments in artificial intelligence and other high-performance computing. The company even [recently bought out](https://www.storagereview.com/news/nvidia-to-acquire-mellanox-for-6-9-billion) Mellanox. Earlier this month, NVIDIA announced they were looking to [acquire Cumulus](https://www.storagereview.com/news/nvidia-to-acquire-cumulus) as well.

![NVIDIA A100](https://www.storagereview.com/wp-content/uploads/2020/05/StorageReview-NVIDIA-DGX-A100-installed-at-Argonne-National-Laboratory-to-fight-COVID-19-Image-courtesy-Argonne-National-Laboratory.jpg)

NVIDIA’s first 7nm GPU is the NVIDIA A100. The A100 is based on NVIDIA’s Ampere architecture and contains 54 billion transistors. Like previous NVIDIA data center GPUs, the A100 includes Tensor Cores. Tensor cores are specialized parts of the GPU designed specifically to quickly perform a type of matrix multiplication and addition calculation commonly used in inferencing.With new beefier GPUs, comes new, beefier Tensor Cores. Previously, NVIDIA’s Tensor Cores could only support up to thirty-two bit floating-point numbers. The A100 supports sixty-four bit floating-point operations, allowing for much greater precision.

Also new in the A100 is a multi-instance GPU capability. Each A100 GPU is capable of splitting into as many as seven independent instances to address a large number of tasks simultaneously.

## **NVIDIA A100 Specifications**

|  | |
| --- | --- |
| Transistor Count | 54 billion |
| Die Size | 826 mm2 |
| FP64 CUDA Cores | 3,456 |
| FP32 CUDA Cores | 6,912 |
| Tensor Cores | 432 |
| Streaming Multiprocessors | 108 |
| FP64 | 9.7 teraFLOPS |
| FP64 Tensor Core | 19.5 teraFLOPS |
| FP32 | 19.5 teraFLOPS |
| TF32 Tensor Core | 156 teraFLOPS \| 312 teraFLOPS\* |
| BFLOAT16 Tensor Core | 312 teraFLOPS \| 624 teraFLOPS\* |
| FP16 Tensor Core | 312 teraFLOPS \| 624 teraFLOPS\* |
| INT8 Tensor Core | 624 TOPS \| 1,248 TOPS\* |
| INT4 Tensor Core | 1,248 TOPS \| 2,496 TOPS\* |
| GPU Memory | 40 GB |
| GPU Memory Bandwidth | 1.6 TB/s |
| Interconnect | NVLink 600 GB/s PCIe Gen4 64 GB/s |
| Multi-Instance GPUs | Various Instance sizes with up to 7MIGs @5GB |
| Form Factor | 4/8 SXM GPUs in HGX A100 |
| Max Power | 400W (SXM) |

In addition to the single A100 GPU, NVIDIA is simultaneously releasing two clustered GPUs as well. The NVIDIA DGX A100 system features eight NVIDIA A100 GPUs interconnected with NVIDIA NVSwitch. It’s smaller brother, NVIDIA HGX A100 is made up of four A100 GPUs interconnected through NVLink. Both NVLINK and NVSwitch allow the individual GPUs to work together on large tasks. NVLink is a true all-to-all interconnect. In order to handle the larger number of GPUs on the NVSwitch interconnects, NVIDIA settled for cross-connecting the NVLinks between the GPUs together. NVIDIA has beefed up their all-to-all interconnect for the new A100, doubling the connectivity to support the much more powerful cores in the chips. NVIDIA claims that they’ve more than doubled the performance of their previous DGX system. According to them, their new eight GPU DGX A100 can perform an incredible five petaflops. Their previous generation, the DGX-2 sixteen GPUs, but only manages two petaflops. I didn’t expect to be using the word “only” with any system that boasted two petaflops anytime soon, but when the new cluster more than doubles the performance with half the number of GPUs, it seems fitting. The DGX A100 also boasts 320GB of memory and nine NVIDIA Mellanox ConnectX-6 HDR 200Gb per second network interfaces, offering a total of 3.6Tb per second of bi-directional bandwidth.

To put the sheer power of the DGX A100 into perspective, the tenth most powerful supercomputer in the world is benchmarked at 18 petaflops. Shove a couple of NVIDIA’s new bad boys together, and you’ve got your very own world-class supercomputer. Astonishingly, NVIDIA has released a DGX SuperPOD reference architecture which does just that. If the system performs as well as NVIDIA claims, the next few months might be very strange for supercomputing enthusiasts.

Back in the normal world, with more typical use-cases, NVIDIA has also announced plans to release an edge server using their new GPUs by the end of the year. The EGX A100 will be powered by just one of the new A100 GPUs. NVIDIA plans for the EGX A100 edge server to run on Red Hat Enterprise Linux. The appliances will likely use NVIDIA’s recently acquired Mellanox ConnectX-6 Dx network cards to receive up to 200Gbps of data and send it directly to the GPU memory for AI or 5G signal processing. That NVIDIA itself isn’t planning on releasing an appliance with just one of their new GPUs in it until the end of the year really underlines what a wild idea clustering multiple DGX A100s, which themselves are clusters of eight A100s, together, really is.

[NVIDIA Main Site](https://www.nvidia.com/en-us/)

[Discuss on Reddit](https://www.reddit.com/r/StorageReview/comments/gjoc7x/nvidia_a100_announced_at_gtc_2020/)

**Engage with StorageReview**

[Newsletter](https://www.storagereview.com/storage_newsletter) |  [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast  [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") |  [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") |  [Twitter](https://twitter.com/storagereview "Opens in a new window") |  [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") |  [RSS Feed](https://www.storagereview.com/rss.xml)

![]()

### Michael Rink

I'm a content contributor at StorageReview and a senior full stack software engineer. I've led both devops and development teams ranging from single engineer projects to flagship projects requiring triple-digits of engineers with teams spread all across the globe. I also enjoy dancing, writing, reading, making games, and tending to my garden.

Previous post: [NVIDIA Mellanox ConnectX-6 Lx SmartNIC Announced](https://www.storagereview.com/news/nvidia-mellanox-connectx-6-lx-smartnic-announced)

Next post: [New Lenovo ThinkCentre Desktops & ThinkPad P Laptops](https://www.storagereview.com/news/new-lenovo-thinkcentre-desktops-thinkpad-p-laptops)

Trusted Vendors

Products and solutions from our affiliate partners:

- [  
  ![Ubiquiti Logo](https://www.storagereview.com/wp-content/uploads/2024/11/2-1.webp)  
   Ubiquiti  
  ](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window")
- [  
  ![Newegg Logo](https://www.storagereview.com/wp-content/uploads/2025/11/newegg.webp)  
   Newegg  
  ](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window")
- [  
  ![Amazon Logo](https://www.storagereview.com/wp-content/uploads/2025/11/amazon.webp) Amazon  
  ](https://amzn.to/4fLJUEW "Opens in a new window")

Newsletter

Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam!

1  

Leave this field empty if you’re human:

## Advertisement

Content Categories

[Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview)

Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved.

Manage your privacy

To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions.

Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen.

Functional Functional Always active

The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.

Preferences Preferences

The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.

Statistics Statistics

The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.

Marketing Marketing

The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.

Statistics

Marketing

Features

Always active

Special features

Special purposes

Always active

- Manage options
- Manage services
- Manage {vendor\_count} vendors
- [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/)

Accept Deny Manage options Save preferences Manage options

- {title}
- {title}
- {title}

Manage your privacy

To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.

Functional Functional Always active

The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.

Preferences Preferences

The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.

Statistics Statistics

The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.

Marketing Marketing

The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.

Statistics

Marketing

Features

Always active

Special features

Special purposes

Always active

- Manage options
- Manage services
- Manage {vendor\_count} vendors
- [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/)

Accept Deny Manage options Save preferences Manage options

- {title}
- {title}
- {title}

Manage consent Manage consent

```json
{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/news\/nvidia-a100-announced-at-gtc-2020","url":"https:\/\/www.storagereview.com\/news\/nvidia-a100-announced-at-gtc-2020","name":"NVIDIA A100 Announced At GTC 2020 - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-a100-announced-at-gtc-2020#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-a100-announced-at-gtc-2020#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/05\/StorageReview-NVIDIA-DGX-A100-installed-at-Argonne-National-Laboratory-to-fight-COVID-19-Image-courtesy-Argonne-National-Laboratory.jpg","datePublished":"2020-05-14T15:03:13+00:00","dateModified":"2020-05-14T16:45:06+00:00","description":"NVIDIA’s first 7nm GPU is the NVIDIA A100. The A100 is based on NVIDIA’s Ampere architecture and contains 54 billion transistors.","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/news\/nvidia-a100-announced-at-gtc-2020#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/news\/nvidia-a100-announced-at-gtc-2020"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/news\/nvidia-a100-announced-at-gtc-2020#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/05\/StorageReview-NVIDIA-DGX-A100-installed-at-Argonne-National-Laboratory-to-fight-COVID-19-Image-courtesy-Argonne-National-Laboratory.jpg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/05\/StorageReview-NVIDIA-DGX-A100-installed-at-Argonne-National-Laboratory-to-fight-COVID-19-Image-courtesy-Argonne-National-Laboratory.jpg","width":850,"height":638,"caption":"NVIDIA A100"},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/news\/nvidia-a100-announced-at-gtc-2020#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.storagereview.com\/news"},{"@type":"ListItem","position":3,"name":"NVIDIA A100 Announced At GTC 2020"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]}
```
