--- description: "Microsoft Maia 300: N2P chiplets, 8 HBM4 stacks at 18TB/s, 950W, 96 accelerators per 167kW rack, 12,288-chip superpods, production in 2027." title: Microsoft Maia 300 Puts 288GB of HBM4 at 18TB/s on an N2P Chiplet and 96 Accelerators in a 167kW Rack image: https://www.storagereview.com/wp-content/uploads/2026/10/StorageReview-Microsoft-Maia-300-chip.jpg --- [![Storage Review]()](https://storagereview.com/) --- [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [![StorageReview.com](https://www.storagereview.com/wp-content/uploads/2026/07/Storage-Review-2x.png)](https://www.storagereview.com) ≡ Menu - [Home](https://www.storagereview.com/) - [Storage Reviews](https://www.storagereview.com/review) - [End User Reviews](https://www.storagereview.com/consumer) - [Enterprise Reviews](https://www.storagereview.com/enterprise) - [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews) - [SR Merch](https://store.storagereview.com) - [Leaderboards](https://www.storagereview.com/best) - [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays) - [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds) - [Best Servers](https://www.storagereview.com/best/servers) - [Best Enterprise GPUs](https://www.storagereview.com/best/enterprise-gpus) - [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai) - [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai) - [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools) - [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware) - [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives) - [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds) - [Best Business Laptops](https://www.storagereview.com/best/business-laptops) - [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations) - [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations) - [Best Mini PCs](https://www.storagereview.com/best/mini-pcs) - [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life) - [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide) - [About SR](https://www.storagereview.com/about-storagereview) - [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations) Search [Home](https://www.storagereview.com/) » [News](https://www.storagereview.com/news) » Microsoft Maia 300 Puts 288GB of HBM4 at 18TB/s on an N2P Chiplet and 96 Accelerators in a 167kW Rack # Microsoft Maia 300 Puts 288GB of HBM4 at 18TB/s on an N2P Chiplet and 96 Accelerators in a 167kW Rack by Brian Beeler on October 12, 2026 [AI](https://www.storagereview.com/enterprise/ai)  ◇  [Enterprise](https://www.storagereview.com/enterprise) Microsoft unveiled Azure Maia 300 today at the OCP Global Summit, the third generation of its in-house inference accelerator and the first built as a multi-chiplet part. Each accelerator pairs a TSMC N2P compute die with eight HBM4 stacks for 288GB of memory at 18TB/s inside a 950W TDP, and a Maia 300 rack holds 96 of them in a 167kW envelope. Microsoft claims 40% more tokens per megawatt than leading GPU-based systems and up to 7x the rack-scale token throughput of Maia 200. Production deployments begin in 2027 as part of what Microsoft describes as multi-gigawatt Maia deployments. ![Microsoft Azure Maia 300 accelerator package on a stand, lit in blue](https://www.storagereview.com/wp-content/uploads/2026/10/StorageReview-Microsoft-Maia-300-chip.jpg) ## Maia 300 Silicon: N2P Compute Die, Eight HBM4 Stacks, 32 Ports of 400G Maia 200 was a monolithic N3P die with six HBM3E stacks. Maia 300 splits the design into a main compute die on N2P, two I/O dies, and four memory dies, with the eight HBM4 stacks taking capacity from 216GB to 288GB and bandwidth from 7.1TB/s to 18TB/s. Peak compute moves less: 13.8 POPS at FP4 and 6.9 POPS at FP8, up from 10.1 and 5.1, so the generation is a 37% gain in FP4 compute against a 2.5x gain in memory bandwidth. Microsoft’s summary of the chip is 2.5x the bandwidth, 33% more capacity, and about 2x the HBM bandwidth per watt of Maia 200. ![Microsoft Azure Maia 300 chip installed on a server board between heatsinks, lit in red and blue]() The compute side is organized as four clusters of 12 tiles, each tile carrying a tensor unit, a vector processor, a reshaper, a DMA engine, and local SRAM, with a shared cluster SRAM and a network-on-chip above that. Microsoft calls the approach a software-defined dataflow architecture: software places data across those local memories, DMA engines, and the network. The SoC exposes PCIe Gen6 x16 to the host and 32 ports of 400Gb/s Ethernet through an on-die AI network controller, which is the scale-up fabric. On Maia 300, the memory organization moves from uniform access to a NUMA layout across the chiplets so data can be placed near the compute that uses it, and precision drops further with enhanced MXFP4 and hardware data type conversion, aimed at cutting the bytes moved per token for both compute and KV cache storage. Kernels can also use on-die SRAM as a software-managed scratchpad to keep traffic off HBM. Microsoft attributes the per-watt gain to those changes, since the TDP rises from 750W to 950W while the company claims more than 2.5x the performance per watt. ## 96 Accelerators per Rack, 12,288 in a Superpod A Maia 300 rack doubles the accelerator count to 96 and raises rack power from 64kW to 167kW, which works out to about 1.74kW per accelerator slot with networking, cooling, and power conversion included. Across the rack, that is 27.6TB of HBM, 1,728TB/s of aggregate HBM bandwidth, and 1,324 POPS of FP4 by Microsoft’s figures, against 10.4TB, 341TB/s, and 485 POPS for a Maia 200 rack. Bidirectional scale-up bandwidth per accelerator rises from 2.8TB/s to 3.2TB/s, and the two-tier Ethernet scale-up network with Microsoft’s custom AI transport now reaches a superpod of 12,288 accelerators, double the roughly 6,000 of the prior generation. ![Microsoft Azure Maia 300 rack with network cabling and liquid cooling manifolds]() Microsoft’s rack diagram shows jobs sharded across racks over the scale-up fabric with expert-parallel traffic between shards, which is the traffic pattern that large mixture-of-experts models generate at serving time. The company says the same communication model covers any accelerator in the superpod, so a 16-accelerator job and a job spanning four racks use the same semantics. ## Maia 300 Specifications | **Specification** | **Maia 300** | **Maia 200** | | --- | --- | --- | | **Accelerator** | | | | **Process** | **Multi-chiplet, N2P compute die** | Monolithic N3P | | **FP4 peak** | **13.8 POPS** | 10.1 POPS | | **FP8 peak** | **6.9 POPS** | 5.1 POPS | | **SoC TDP** | **950W** | 750W | | **HBM** | **8 x HBM4, 288GB, 18TB/s** | 6 x HBM3E, 216GB, 7.1TB/s | | **Host interface** | **PCIe Gen6 x16** | Not stated | | **Scale-up bandwidth (bidirectional)** | **3.2TB/s** | 2.8TB/s | | **Back-end network** | **Two-tier Ethernet scale-up with AI transport, 32 x 400Gb/s** | Two-tier Ethernet scale-up with AI transport | | **Rack and Scale-Up Domain** | | | | **Accelerators per rack** | **96** | 48 | | **Rack power** | **167kW** | 64kW | | **Rack HBM capacity** | **27.6TB** | 10.4TB | | **Rack HBM bandwidth** | **1,728TB/s** | 341TB/s | | **Rack FP4 peak** | **1,324 POPS** | 485 POPS | | **Scale-up domain** | **About 12,288 accelerators** | About 6,000 accelerators |   ## Where Maia 300 Fits and What the Claims Rest On Maia 200 is now in production behind Microsoft Copilot and the MAI model team, with GitHub Copilot and Microsoft Foundry due to move onto it by the end of the year, and Microsoft says it is deploying across the United States, Europe, and Australia with up to 1.7x more tokens per watt than its GPU infrastructure for the built-in AI features in Teams, Copilot, and Cowork. “We will scale our Azure Maia family to multi-gigawatt deployments starting in 2027, making Maia the primary inference system for Microsoft products and services,” wrote Scott Guthrie, executive vice president of Cloud + AI, in announcing Maia 300. NVIDIA and AMD remain in Microsoft’s training fleet, and the company has not offered Maia as an instance type Azure customers can rent. The headline efficiency claim, 40% more tokens per megawatt than leading GPU-based systems, does not name the GPU, the model, or the serving configuration, and because Maia runs only inside Microsoft, nobody outside the company can test it. The published specifications do support the design: per-accelerator memory bandwidth rose 2.5x while FP4 compute rose 37%, and the rack delivers 5.1x the HBM bandwidth of a Maia 200 rack on 2.6x the power. That is a chip built for the decode phase of long-context and agentic inference, where the bottleneck is feeding the arithmetic units, and it indicates how a hyperscaler sizes an inference part when it owns the workload end to end. We covered the [Maia 200 launch](https://www.storagereview.com/news/maia-200-signals-microsofts-push-toward-custom-silicon-for-ai-inference) in January, and Microsoft says more detail is coming at Ignite in November. ![Microsoft chart comparing Maia 300 and Maia 200 specifications, with a labeled Maia 300 package showing the compute die, I/O dies, memory dies, and HBM4 stacks]() ### [Azure Maia 300](https://azure.microsoft.com/en-us/blog/deep-dive-into-azure-maia-300-architecture) **Engage with StorageReview** [Newsletter](https://www.storagereview.com/storage_newsletter) |  [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast  [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") |  [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") |  [Twitter](https://twitter.com/storagereview "Opens in a new window") |  [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") |  [RSS Feed](https://www.storagereview.com/rss.xml) ![]() ### Brian Beeler Brian is located in Cincinnati, Ohio and is the chief analyst and President of StorageReview.com. Previous post: [Intel GPU D-Series Packs 480GB LPDDR5X and 1.3 PFLOPS FP8 into a 350W PCIe Card](https://www.storagereview.com/news/intel-gpu-d-series-480gb-lpddr5x-1-3-pflops-fp8-350w-pcie-card) Next post: [IBM Bob Goes Self-Hosted: Air-Gapped Agentic Development With Nemotron and Poolside Laguna On Premises](https://www.storagereview.com/news/ibm-bob-self-hosted-air-gapped-agentic-development-nemotron-poolside-laguna) Trusted Vendors Products and solutions from our affiliate partners: - [ ![Ubiquiti Logo](https://www.storagereview.com/wp-content/uploads/2024/11/2-1.webp) Ubiquiti ](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window") - [ ![Newegg Logo](https://www.storagereview.com/wp-content/uploads/2025/11/newegg.webp) Newegg ](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window") - [ ![Amazon Logo](https://www.storagereview.com/wp-content/uploads/2025/11/amazon.webp) Amazon ](https://amzn.to/4fLJUEW "Opens in a new window") Newsletter Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam! 1 Leave this field empty if you’re human: ## Advertisement Content Categories [Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved. Manage your privacy To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions. Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage your privacy To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage consent Manage consent ```json {"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/news\/microsoft-maia-300-hbm4-n2p-chiplet-96-accelerator-rack","url":"https:\/\/www.storagereview.com\/news\/microsoft-maia-300-hbm4-n2p-chiplet-96-accelerator-rack","name":"Microsoft Maia 300 Puts 288GB of HBM4 at 18TB\/s on an N2P Chiplet and 96 Accelerators in a 167kW Rack - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/news\/microsoft-maia-300-hbm4-n2p-chiplet-96-accelerator-rack#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/news\/microsoft-maia-300-hbm4-n2p-chiplet-96-accelerator-rack#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2026\/10\/StorageReview-Microsoft-Maia-300-chip.jpg","datePublished":"2026-10-12T19:45:29+00:00","description":"Microsoft Maia 300: N2P chiplets, 8 HBM4 stacks at 18TB\/s, 950W, 96 accelerators per 167kW rack, 12,288-chip superpods, production in 2027.","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/news\/microsoft-maia-300-hbm4-n2p-chiplet-96-accelerator-rack#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/news\/microsoft-maia-300-hbm4-n2p-chiplet-96-accelerator-rack"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/news\/microsoft-maia-300-hbm4-n2p-chiplet-96-accelerator-rack#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2026\/10\/StorageReview-Microsoft-Maia-300-chip.jpg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2026\/10\/StorageReview-Microsoft-Maia-300-chip.jpg","width":1920,"height":1080,"caption":"Microsoft Azure Maia 300 accelerator package on a stand, lit in blue"},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/news\/microsoft-maia-300-hbm4-n2p-chiplet-96-accelerator-rack#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.storagereview.com\/news"},{"@type":"ListItem","position":3,"name":"Microsoft Maia 300 Puts 288GB of HBM4 at 18TB\/s on an N2P Chiplet and 96 Accelerators in a 167kW Rack"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]} ```