--- description: Thanks to the partnership with Intel and NVIDIA on the Dell PowerEdge XE9680, the server is not only powerful but highly efficient. title: Dell PowerEdge XE9680 Review: My Favorite Server Ever Tested image: https://www.storagereview.com/wp-content/uploads/2023/03/StorageReview-Dell-XE9680-3.jpg --- [](//storagereview.com/) --- [ ](https://www.facebook.com/@storagereview) [ ](https://twitter.com/storagereview) [ ](https://www.instagram.com/storagereview/) [ ](https://www.linkedin.com/company/storagereview-com) [ ](https://www.youtube.com/user/storagereview?sub%5Fconfirmation=1) [ ](mailto:info@storagereview.com) [ ](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [ ](https://www.reddit.com/r/StorageReview/) [ ](https://discord.gg/TwMHb4azdC) [ ](https://www.storagereview.com/rss.xml) [ ](https://www.tiktok.com/@storagereview) [![StorageReview.com](https://www.storagereview.com/wp-content/uploads/2026/07/Storage-Review-2x.png)](https://www.storagereview.com) ≡ Menu * [Home](https://www.storagereview.com/) * [Storage Reviews](https://www.storagereview.com/review) * [Consumer Reviews](https://www.storagereview.com/consumer) * [Enterprise Reviews](https://www.storagereview.com/enterprise) * [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews) * [SR Merch](https://store.storagereview.com) * [Leaderboards](https://www.storagereview.com/best) * [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays) * [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds) * [Best Servers](https://www.storagereview.com/best/servers) * [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai) * [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai) * [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools) * [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware) * [Best SSDs & Hard Drives](https://www.storagereview.com/best%5Fdrives) * [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds) * [Best Business Laptops](https://www.storagereview.com/best/business-laptops) * [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations) * [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations) * [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life) * [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide) * [About SR](https://www.storagereview.com/about-storagereview) * [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations) Search [Home](https://www.storagereview.com/) » [Review](https://www.storagereview.com/review) » Dell PowerEdge XE9680 Review: My Favorite Server Ever Tested # Dell PowerEdge XE9680 Review: My Favorite Server Ever Tested by Jordan Ranous on August 15, 2023 [AI](https://www.storagereview.com/enterprise/ai) ◇ [Enterprise](https://www.storagereview.com/enterprise) We usually wait until the end of the article to paint the whole picture and complete the review. However, the Dell PowerEdge XE9680 presents such an exciting piece of hardware we couldn’t wait to share our excitement with this positive review. Dell’s design is centered around the needs of AI, providing an immense amount of computational power in a 6U form factor. Thanks to Dell’s partnership with Intel and NVIDIA on the XE9680, they have come up with an offering that is not only powerful but highly efficient. ![Dell PowerEdge XE9680 with heatsink on top](https://www.storagereview.com/wp-content/uploads/2023/05/StorageReview-Dell-PowerEdge-XE9680-DW-5-1024x765.jpg) ## **Dell PowerEdge XE9680** Its specs are nothing short of impressive; two 4th Generation Intel Xeon Scalable processors, 56 cores each, and 2TB of DDR5 ram provide the CPU backbone for the AI accelerators. Then adding in the eight NVIDIA HGX H100 or A100 GPUs, connected on SXM and together through NVLink, the server is equipped to handle the largest of models and data workloads. ![Dell PowerEdge XE9680 RAM]() The PowerEdge XE9680’s capacity for large RAM volumes (up to 4TB) provides a significant competitive edge in handling AI workloads. Such large memory footprints allow for the training of more complex models, leading to higher performance and more accurate results. Our configurations include 8x U.2 NVMe SSD bays in the front. But just as we saw with the [R660](https://www.storagereview.com/review/dell-poweredge-r660-e3-s-backplane-review), Dell intends to offer an E3.S backplane as well, with 16x E3.S SSDs. The server also supports the NVMe BOSS-N1 boot drive rig on the rear of the server. ## It’s About More Than Just Power The PowerEdge XE9680 is not just about power; it also prioritizes security and manageability. With features like cryptographically signed firmware, Data at Rest Encryption, and Secure Boot, the server ensures your data is always protected. The embedded iDRAC9 system provides an easy-to-use management interface, offering a variety of tools and integrations that make managing the server straightforward and hassle-free. ![Dell PowerEdge XE9680 iDRAC GPUs]() We put this system to the test when we wanted to switch up the OS install (more on this later) on the server, and it was simpler to use the Cryptographic Erase function of the iDRAC with only a few clicks to start with a clean system to work with. ![nvidia-smi on the xe9680 with H100 cards, shitload of GPU power]() nvidia-smi on the XE9680 with H100 cards [Previously we looked at Dell’s whitepaper](https://www.storagereview.com/news/the-dell-poweredge-xe9680-for-generative-ai-stable-platform-stable-diffusion-superior-performance) on the XE9680 and the performance of the Dell PowerEdge XE9680 server when evaluated against the image generation latency benchmarks set by Lambda. The server delivered roughly double the throughput, which is a testament to the power and efficiency of the PowerEdge XE9680. [The MLPerf scores](https://infohub.delltechnologies.com/p/unlocking-machine-learning-with-dell-poweredge-xe9680-insights-into-mlperf-2-1-training-performance/) are widely known and accepted as a good rank positioning of performance of systems in this class, so to take advantage of our hands-on time with the XE9680 A100 and H100 servers, we decided to run a head-to-head comparison of fine-tuning Meta’s LLaMa with the two systems. To do this, we followed Stanford’s Alpaca training steps, which they accomplished using 4x A100 systems. ![Dell XE9680]() ## Alpaca Training on the XE9680 We want to thank the teams at NVIDIA and Dell for their assistance with this project. This is such a cutting-edge technology from a hardware and software perspective that without the guidance of industry experts from both companies, it would have been a much more drawn-out, intensive process. On the A100 system, using the process outlined on the Stanford Alpaca Git Hub, we could reproduce the steps to create the Alpaca checkpoints completing the three epoch’s of training, averaging approximately 90 minutes. Moving to the H100 system, we saw an improvement with runs completed in around 70 minutes per run. Due to the high demand and limited nature of these systems, we did not have an opportunity to tune the code itself to explore possible performance improvements, and it was clear that with refinement and time dedicated to development, an enterprise team could achieve a rapid turn time with fine-tuning. ## **Officially Unofficial** On the A100-flavored XE9680, we had an opportunity to do some outside-the-box and highly unorthodox testing. We installed Windows Server 2022 on the system! This involved some iDRAC drive wipes to remove the Linux installation, some tricks with iDRAC .iso files and virtual media to sideload Intel Network drivers, and from there, it was off to the races. Using the chipset drives from a comparable Dell PowerEdge system and then official NVIDIA A100 Drivers. ![Dell PowerEdge XE9680 Windows NVIDIA]() The system works and is stable with no issues. However, this is a highly unusual use case that Dell does not officially support. So armed with our fresh Windows install and eight of the best GPUs on the market, we did [what we do best](https://www.storagereview.com/review/storagereview-calculated-100-trillion-digits-of-pi-in-54-days-besting-google-cloud), benchmark Pi! The eight NVIDIA A100 cards easily crushed GPU-Pi world records without any tuning, and the Xeon Platinum CPUs threw up some great numbers on both y-cruncher and Cinebench. We tried a few of our other standard CPU/GPU benchmarks with little hope of them working, and as expected, we ran into software/encoder issues that prevented successful runs. Procyon, for example, didn’t even understand that it had Tensor GPUs available to do the test. Again we need to reiterate that this was simply a test of an unsupported configuration, and the fact that we got anything working at all is impressive and a testament to Dell’s ability to produce consistent hardware across platforms. Using Windows Server on this type of system in any production environment would be unwise. | Test | Result | | ------------------- | ----------------------------- | | Cinebench Multi | 90,710 | | Cinebench Single | 174 | | CB MP Ration | 77.24 | | | | | Geekbench 6 GPU | 197,669 | | Geekbench 6 Single | 1,678 | | Geekbench6 Multi | 16,425 | | | | | Monster: | 855.080461 samples per minute | | Junkshop: | 546.636998 samples per minute | | Classroom: | 394.441850 samples per minute | | | | | GPU Pi 3.2 1Billion | 0.394 Seconds | | GPU Pi 3.3 1Billion | 0.317 Seconds | It’s worth noting that such impressive performance doesn’t just translate into speed but also impacts the practical application of AI. With faster retraining and finetuning ability, businesses can significantly improve their agility, allowing them to swiftly respond to market changes, customer needs, and internal requirements. For instance, design teams can evaluate and refine concepts in real-time, significantly reducing time to market, or compliance teams can continually train and finetune updated models with the latest policies and procedures for an assistant-type LLM. ## Transforming Operations Using Generative AI The Dell PowerEdge XE9680 can facilitate generative AI in transforming several industry operations. Imagine a retail scenario where AI can swiftly generate realistic images of various product configurations or color options based on customer preferences or a construction business creating visualizations of new buildings for planning and sales presentations. The possibilities are fascinating. The Dell PowerEdge XE9680 offers a fantastic blend of power, efficiency, and versatility. It is a high-performance server that can handle demanding AI workloads with ease. And while it is specifically designed to cater to AI workloads, its capabilities give it the potential to be useful for other applications. Coupled with Dell’s commitment to aiding organizations in executing their AI projects via [Project Helix](https://www.storagereview.com/news/dell-project-helix-secure-on-premises-generative-ai), the PowerEdge XE9680 is an exciting proposition and one of the best hardware innovations we’ve seen all year. With its ability to deliver raw power, refined finesse and enterprise-grade lifecycle management, it’s no wonder that the Dell PowerEdge XE9680 is fast becoming an aspirational favorite among enterprise servers. ![]() [Dell XE9680](https://www.dell.com/en-us/shop/ipovw/poweredge-xe9680) [NVIDIA A100](https://www.nvidia.com/en-us/data-center/a100/) **Engage with StorageReview** [Newsletter](https://www.storagereview.com/storage%5Fnewsletter) | [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/[Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") | [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") | [Twitter](https://twitter.com/storagereview "Opens in a new window") | [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") | [RSS Feed](https://www.storagereview.com/rss.xml) ![]() ### Jordan Ranous AI Specialist; navigating you through the world of Enterprise AI. Writer and Analyst for Storage Review, coming from a background of Financial Big Data Analytics, Datacenter Ops/DevOps, and CX Analytics. Pilot, Astrophotographer, LTO Tape Guru, and Battery/Solar Enthusiast. Previous post: [The Quinn Effect: Understanding Why Generative AI, Like LLMs, Sometimes Go Off The Rails](https://www.storagereview.com/review/the-quinn-effect-understanding-why-generative-ai-like-llms-sometimes-go-off-the-rails) Next post: [Synology DS224+ Review](https://www.storagereview.com/review/synology-ds224-review) Trusted Vendors Products and solutions from our affiliate partners: * [ ![Ubiquiti Logo](https://www.storagereview.com/wp-content/uploads/2024/11/2-1.webp) Ubiquiti ](https://store.ui.com/us/en?a%5Faid=StorageReview "Opens in a new window") * [ ![Newegg Logo](https://www.storagereview.com/wp-content/uploads/2025/11/newegg.webp) Newegg ](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window") * [ ![Amazon Logo](https://www.storagereview.com/wp-content/uploads/2025/11/amazon.webp) Amazon ](https://amzn.to/4fLJUEW "Opens in a new window") Newsletter Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam! 1 Leave this field empty if you’re human: ## Advertisement Content Categories [ Facebook ](https://www.facebook.com/@storagereview) [ X ](https://twitter.com/storagereview) [ Instagram ](https://www.instagram.com/storagereview/) [ LinkedIn ](https://www.linkedin.com/company/storagereview-com) [ YouTube ](https://www.youtube.com/user/storagereview?sub%5Fconfirmation=1) [ Email ](mailto:info@storagereview.com) [ Spotify ](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [ Reddit ](https://www.reddit.com/r/StorageReview/) [ Discord ](https://discord.gg/TwMHb4azdC) [ RSS ](https://www.storagereview.com/rss.xml) [ TikTok ](https://www.tiktok.com/@storagereview) Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved. Manage your privacy To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions. Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Always active * [Manage options](#) * [Manage services](#) * [Manage {vendor\_count} vendors](#) * [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences [Manage options](#) * [{title}](#) * [{title}](#) * [{title}](#) Manage your privacy To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Always active * [Manage options](#) * [Manage services](#) * [Manage {vendor\_count} vendors](#) * [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences [Manage options](#) * [{title}](#) * [{title}](#) * [{title}](#) Manage consent Manage consent ```json {"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/review\/dell-poweredge-xe9680-review-my-favorite-server-ever-tested","url":"https:\/\/www.storagereview.com\/review\/dell-poweredge-xe9680-review-my-favorite-server-ever-tested","name":"Dell PowerEdge XE9680 Review: My Favorite Server Ever Tested - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/review\/dell-poweredge-xe9680-review-my-favorite-server-ever-tested#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/review\/dell-poweredge-xe9680-review-my-favorite-server-ever-tested#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/03\/StorageReview-Dell-XE9680-3.jpg","datePublished":"2023-08-15T19:38:18+00:00","description":"Thanks to the partnership with Intel and NVIDIA on the Dell PowerEdge XE9680, the server is not only powerful but highly efficient.","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/review\/dell-poweredge-xe9680-review-my-favorite-server-ever-tested#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/review\/dell-poweredge-xe9680-review-my-favorite-server-ever-tested"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/review\/dell-poweredge-xe9680-review-my-favorite-server-ever-tested#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/03\/StorageReview-Dell-XE9680-3.jpg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2023\/03\/StorageReview-Dell-XE9680-3.jpg","width":1200,"height":761,"caption":"Dell XE9680"},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/review\/dell-poweredge-xe9680-review-my-favorite-server-ever-tested#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"Review","item":"https:\/\/www.storagereview.com\/review"},{"@type":"ListItem","position":3,"name":"Dell PowerEdge XE9680 Review: My Favorite Server Ever Tested"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]} ```