--- description: Broadcom's Thor Ultra 800G AI Ethernet NIC is designed for clusters with more than 100,000 XPUs, making it ready to scale. title: "Broadcom Thor Ultra: UEC-Compliant 800G AI Ethernet NIC for 100K+ XPU Scale-Out" image: https://www.storagereview.com/wp-content/uploads/2025/10/Storagereview-Broadcom-OCP-Board.jpg --- [![Storage Review]()](https://storagereview.com/) --- [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [![StorageReview.com]()](https://www.storagereview.com) ≡ Menu - [Home](https://www.storagereview.com/) - [Storage Reviews](https://www.storagereview.com/review) - [Consumer Reviews](https://www.storagereview.com/consumer) - [Enterprise Reviews](https://www.storagereview.com/enterprise) - [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews) - [SR Merch](https://store.storagereview.com) - [Leaderboards](https://www.storagereview.com/best) - [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays) - [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds) - [Best Servers](https://www.storagereview.com/best/servers) - [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai) - [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai) - [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools) - [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware) - [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives) - [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds) - [Best Business Laptops](https://www.storagereview.com/best/business-laptops) - [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations) - [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations) - [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life) - [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide) - [About SR](https://www.storagereview.com/about-storagereview) - [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations) Search [Home](https://www.storagereview.com/) » [News](https://www.storagereview.com/news) » Broadcom Thor Ultra: UEC-Compliant 800G AI Ethernet NIC for 100K+ XPU Scale-Out # Broadcom Thor Ultra: UEC-Compliant 800G AI Ethernet NIC for 100K+ XPU Scale-Out by Harold Fritts on October 14, 2025 [Enterprise](https://www.storagereview.com/enterprise)  ◇  [Networking](https://www.storagereview.com/enterprise/networking) Broadcom introduced Thor Ultra, the industry’s first 800G AI Ethernet NIC that is fully compliant with the Ultra Ethernet Consortium (UEC) specifications. It was designed for clusters with more than 100,000 XPUs. Thor Ultra targets the bottlenecks that constrain traditional RDMA, adding packet-level multipathing, out-of-order data placement, hardware SACK-based retransmission, and a fully programmable congestion-control pipeline. ![Broadcom Thor Ultra OCP card]() Thor Ultra OCP card The NIC seamlessly integrates with Broadcom Tomahawk 6 and is compatible with any UEC-compliant switch lineup. Broadcom highlights its security features, including line-rate PSP encryption, secure boot, and attestation. The NIC also offers deployment versatility with 100G/200G SerDes and supports various usage models, including chiplet, IP, PCIe, and OCP 3.0 cards. Thor Ultra serves as a forward-thinking, high-bandwidth, telemetry-enabled component suitable for Ethernet-based AI infrastructures. ### **RDMA for AI Has Hit Its Limits** AI data centers are transitioning from predictable HPC-style processes to unpredictable, bursty, and distributed AI tasks, including training, fine-tuning, and large-scale inference. Under these conditions, traditional RDMA (as used in many RoCE implementations) experiences significant strain. Contributing to the RDMA constraints include: - The absence of genuine multipathing at the packet level forces data flows to use only one path, increasing tail latency during incast events and microbursts. - In-order placement requirements hinder optimal PCIe utilization when packets arrive out of sequence, causing stalls and head-of-line blocking at the host. - Go-Back-N retransmissions increase congestion and lead to bandwidth waste, and recovery from losses is slow. - Tuning congestion control across leaf-spine fabrics at the 100K-node scale is challenging and often varies by vendor. Thor Ultra overcomes these limitations by aligning RDMA semantics more closely with the requirements of large-scale AI fabrics, supporting fine-grained load distribution, reordering tolerance, rapid loss recovery, and programmable congestion control that adapts as UEC evolves. ### **Architecture and Features** Thor Ultra is designed to anchor UEC-compliant AI Ethernet fabrics, featuring a NIC that eliminates bottlenecks on both the host and fabric sides. Thor Ultra features include: - Thor Ultra’s RDMA pipeline uses packet-level multipathing to distribute traffic across multiple paths and supports out-of-order packets directly in XPU memory. It ensures reliability through SACK and retransmissions and features a fully programmable congestion control that supports various algorithms for policy unification and flexibility. - Thor Ultra prioritized full UEC compliance, supporting behaviors for reliability, congestion signaling, and telemetry. It is compatible with Broadcom Tomahawk 6 and other UEC switches, promoting an open Ethernet approach to avoid lock-in and enable mixed-vendor fabrics. - Thor Ultra’s line-rate security includes hardware-accelerated encryption/decryption, secure boot with signed firmware, and device attestation, ensuring supply-chain and runtime integrity in multi-tenant AI clusters. - Scale-out UEC-compliant telemetry features, such as packet trimming and explicit congestion signaling, are supported, enhancing observability, closed-loop congestion control tuning, and quick fault isolation in scale-out fabrics. - The NIC supports 100G and 200G SerDes configurations for flexible port and upgrade options. It uses thermally efficient passive copper DACs up to five meters for short-range rack connections, reducing power and cost. The models include chiplet/IP for custom boards and standard PCIe and OCP 3.0 form factors, all of which share firmware and tools for easier management. ### **Ethernet AI Fabrics vs. Proprietary Alternatives** The launch of Thor Ultra aligns with key competitive aspects. Proprietary AI interconnects include InfiniBand and vendor-specific Ethernet overlays. NVIDIA’s InfiniBand solutions, such as ConnectX/BlueField and Quantum switches, offer features like SHARP, adaptive routing, and optimized congestion control. However, these come with vendor lock-in and increased total cost of ownership (TCO). Thor Ultra’s UEC compliance and advanced RDMA capabilities are designed to match or surpass tail-latency and throughput performance using standard Ethernet. This offers buyers a standards-based alternative, ensuring supply flexibility and familiar toolchains. Unlike NVIDIA’s Ethernet strategy with Spectrum-X, which targets AI fabrics with proprietary scheduling/CC, Broadcom is “UEC-first” openness, plus Tomahawk/Jericho switch scale and a merchant optics ecosystem breadth. However, for many CSPs, like AWS and Google, that deploy custom hardware, UEC may not be a strong selling point. Although deploying custom hardware may cause some heartburn, they believe being in control is more critical than UEC compliance. Intel, AMD (Pensando), Marvell, and NVIDIA provide competing Ethernet NIC, SmartNIC, and DPU solutions for AI clusters, with RoCEv2 improvements and host offloads. Thor Ultra distinguishes itself by delivering 800G line rate, packet-level multipathing with out-of-order placement, hardware SACK retransmissions, and a programmable congestion control engine compatible with UEC. Broadcom’s Tomahawk 6 and Jericho are leading in hyperscale merchant Ethernet. Thor Ultra offers a comprehensive Ethernet AI infrastructure. For operators hesitant about single-vendor ecosystems, UEC compliance and interoperability with other top vendors allow flexibility, enabling Broadcom NICs to work with various UEC switches or vice versa. Thor Ultra boosts Ethernet’s viability for AI at over 100,000 nodes by addressing key RoCE challenges and promoting a standards-based approach, rather than relying on a single vendor’s fabric. ### **AI Data Center Design** Thor Ultra’s capabilities nudge architects toward a few design shifts, which include: - **Fabric standardization on UEC:** Anticipate reference designs that define UEC-compliant NICs and switches, unifying congestion signaling, telemetry, and reliability standards among vendors. This minimizes integration challenges and simplifies multi-source procurement. - **Ethernet-first AI pods feature predictable tail latency through** packet-level multipathing and support for out-of-order placement. These pod designs utilize 800G NICs connected via 100G/200G SerDes lanes to ToR/leaf switches, layered over deep ECMP fabrics. This setup allows designers to be more aggressive with path diversity and oversubscription, all while maintaining low p99 and p99.9 latencies. - **Programmable congestion control as an operational knob:** With CC running in NIC silicon but programmable, operators can adapt to workload phases (data-parallel training vs. pipeline-parallel inference) and fabric conditions without hardware swaps. Expect A/B testing of receiver- vs. sender-based schemes and closed-loop control using UEC telemetry. - **Simpler host datapaths and PCIe efficiency**: Out-of-order placement into XPU memory and hardware SACK reduce CPU/XPU involvement in reorder and recovery, freeing host cycles and smoothing PCIe bandwidth utilization. This matters for GPU/accelerator servers already running at the edge of PCIe and memory bandwidth envelopes. - **Security baked into the NIC:** Line-rate encryption, secure boot, and hardware-attestation ease compliance in multi-tenant clusters, especially when sharing fabric between training and inference tenants or when partitioning across internal teams. - **Cabling and power TCO**: Passive copper DACs up to 5m for NIC-to-ToR runs can lower optics power budgets and simplify rack-level thermals. - **Operational telemetry and SLOs**: UEC telemetry primitives, such as packet trimming and explicit congestion signals, enable tighter SLO management and faster RCA at scale. Integrations into existing NetOps/AI Ops pipelines will be a selection criterion. ### **Deployment** Thor Ultra supports 100G/200G SerDes configurations, ships as a chiplet/IP for custom integrations, and as standard PCIe and OCP 3.0 cards. All variants share a unified firmware, driver, and software toolchain to streamline fleet operations. Broadcom positions Thor Ultra to “drop in” alongside Tomahawk 6, with stated compatibility for UEC-compliant switches from other vendors. ![Broadcom Thor Ultra PCIe card]() Thor Ultra PCIe card Broadcom introduces Thor Ultra as a significant breakthrough in AI Ethernet. This 800G NIC fully supports UEC and offers advanced RDMA capabilities, focusing on performance, scalability, and openness. It enhances the Ethernet-for-AI story by providing an 800G NIC that addresses key limitations of traditional RoCE at hyperscale, including a lack of packet-level multipathing, unreliable in-order delivery, slow retransmissions, and fragile congestion control. **Availability** Broadcom is sampling the Thor Ultra with select customers. **Engage with StorageReview** [Newsletter](https://www.storagereview.com/storage_newsletter) |  [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast  [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") |  [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") |  [Twitter](https://twitter.com/storagereview "Opens in a new window") |  [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") |  [RSS Feed](https://www.storagereview.com/rss.xml) ![]() ### Harold Fritts I have been in the tech industry since IBM created Selectric. My background, though, is writing. So I decided to get out of the pre-sales biz and return to my roots, doing a bit of writing but still being involved in technology. Previous post: [NVIDIA Offers a Preview of What’s Next for Gigawatt-Scale AI Factories at the OCP Global Summit](https://www.storagereview.com/news/nvidia-offers-a-preview-of-whats-next-for-gigawatt-scale-ai-factories-at-the-ocp-global-summit) Next post: [HPE Sharpens iLO 7 and Gen12 Servers at OCP 2025](https://www.storagereview.com/news/hpe-sharpens-ilo-7-and-gen12-servers-at-ocp-2025) Trusted Vendors Products and solutions from our affiliate partners: - [ ![Ubiquiti Logo]() Ubiquiti](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window") - [ ![Newegg Logo]() Newegg](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window") - [ ![Amazon Logo]() Amazon](https://amzn.to/4fLJUEW "Opens in a new window") Newsletter Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam! 1 Leave this field empty if you’re human: ## Advertisement Content Categories [Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved. Manage your privacy To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions. Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage your privacy To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage consent Manage consent ```json {"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/news\/broadcom-thor-ultra-uec-compliant-800g-ai-ethernet-nic-for-100k-xpu-scale-out","url":"https:\/\/www.storagereview.com\/news\/broadcom-thor-ultra-uec-compliant-800g-ai-ethernet-nic-for-100k-xpu-scale-out","name":"Broadcom Thor Ultra: UEC-Compliant 800G AI Ethernet NIC for 100K+ XPU Scale-Out - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/news\/broadcom-thor-ultra-uec-compliant-800g-ai-ethernet-nic-for-100k-xpu-scale-out#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/news\/broadcom-thor-ultra-uec-compliant-800g-ai-ethernet-nic-for-100k-xpu-scale-out#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2025\/10\/Storagereview-Broadcom-OCP-Board.jpg","datePublished":"2025-10-14T16:29:43+00:00","description":"Broadcom's Thor Ultra 800G AI Ethernet NIC is designed for clusters with more than 100,000 XPUs, making it ready to scale.","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/news\/broadcom-thor-ultra-uec-compliant-800g-ai-ethernet-nic-for-100k-xpu-scale-out#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/news\/broadcom-thor-ultra-uec-compliant-800g-ai-ethernet-nic-for-100k-xpu-scale-out"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/news\/broadcom-thor-ultra-uec-compliant-800g-ai-ethernet-nic-for-100k-xpu-scale-out#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2025\/10\/Storagereview-Broadcom-OCP-Board.jpg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2025\/10\/Storagereview-Broadcom-OCP-Board.jpg","width":1324,"height":839},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/news\/broadcom-thor-ultra-uec-compliant-800g-ai-ethernet-nic-for-100k-xpu-scale-out#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.storagereview.com\/news"},{"@type":"ListItem","position":3,"name":"Broadcom Thor Ultra: UEC-Compliant 800G AI Ethernet NIC for 100K+ XPU Scale-Out"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]} ```