--- description: The main objective of this article is to evaluate the impact of storage and GPU on AI workloads. We've used the fastest flash and an NVIDIA T4 to work title: The Impact of Storage and GPU on AI Workloads image: https://www.storagereview.com/wp-content/uploads/2020/06/bytelake-eye-logo.jpg --- [![Storage Review]()](https://storagereview.com/) --- [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [![StorageReview.com]()](https://www.storagereview.com) ≡ Menu - [Home](https://www.storagereview.com/) - [Storage Reviews](https://www.storagereview.com/review) - [End User Reviews](https://www.storagereview.com/consumer) - [Enterprise Reviews](https://www.storagereview.com/enterprise) - [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews) - [SR Merch](https://store.storagereview.com) - [Leaderboards](https://www.storagereview.com/best) - [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays) - [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds) - [Best Servers](https://www.storagereview.com/best/servers) - [Best Enterprise GPUs](https://www.storagereview.com/best/enterprise-gpus) - [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai) - [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai) - [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools) - [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware) - [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives) - [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds) - [Best Business Laptops](https://www.storagereview.com/best/business-laptops) - [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations) - [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations) - [Best Mini PCs](https://www.storagereview.com/best/mini-pcs) - [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life) - [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide) - [About SR](https://www.storagereview.com/about-storagereview) - [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations) Search [Home](https://www.storagereview.com/) » [Review](https://www.storagereview.com/review) » The Impact of Storage and GPU on AI Workloads # The Impact of Storage and GPU on AI Workloads by Brian Beeler on June 26, 2020 [Enterprise](https://www.storagereview.com/enterprise)  ◇  [Software](https://www.storagereview.com/enterprise/software) Hardly a week goes by that we don’t hear from an IT vendor about the impact their solutions have on orgs that are involved in artificial intelligence, deep learning, machine learning or edge intelligence. The problem however is material insights on how these solutions impact the performance of each of these tasks is lacking. Recently we decided to see if we could do something about that by partnering with byteLAKE, an AI and HPC solutions builder based in Poland. The main objective being to evaluate the impact of storage and GPU on AI workloads. ## Impact of Storage on AI Initially, we wanted to explore a popular notion that local storage impacts the performance of AI models. We took one of the [ Dell EMC PowerEdge R740xd](https://www.storagereview.com/review/dell-emc-poweredge-r740xd-server-review) servers in our lab, configuring with two Intel Xeon Gold 6130 CPUs with 256GB of DRAM. We ran the byteLAKE AI test using three different local storage alternatives. For the test we used a legacy  [KIOXIA PX04S](https://www.storagereview.com/review/toshiba-px04s-enterprise-ssd-review) SSD along with the much faster, [Samsung 983 ZET](https://www.storagereview.com/review/samsung-983-zet-review) and [Intel Optane 900P](https://www.storagereview.com/review/intel-optane-ssd-900p-series-review). ![storage gpu AI Dell EMC 740]() During the benchmark, we analyzed performance of the AI learning process. In the tests, we run the learning process for a real-world scenario. In this case the tests were a part of training procedure in one of the byteLAKE products: [EWA Guard](https://www.bytelake.com/en/ewaguard). It is based on the latest YOLO (You Only Look Once) which is a state-of-the-art real-time detection model. The model consists of a single input layer, 22 convolution layers, 5 pooling layers, 2 router layers, a single reorg layer and a single detection layer. As a basic metric of performance, we have used the execution time of training for 5000 epochs. The benchmarks were repeated three times for each storage configuration, and the average values are presented below. Results: - KIOXIA 98h 24m - Samsung 98h 44 - Intel 98h 42 As is clear in the data, local storage had no impact in performance. Testing ranged from a SATA SSD to the latest and greatest Optane, with no impact whatsoever. That said, storage may play a more important role when it comes to data ingress and egress, but computationally for AI, in this case there was no impact. ## Impact of GPU and Storage on AI With the storage data in-hand, we added a single NVIDIA T4 to the PowerEdge to gauge impact of a GPU on the AI. For this testing, we ran the same three storage configurations as well. ![NVIDIA Tesla T4]() Results: - KIOXIA 4h 30 - Samsung 4h 28m - Intel 4h 27m As expected, the GPU made an impact, an exponential impact in fact, driving a 22x improvement. With the GPU accelerating the overall performance of the AI, there was some thought that the faster storage may make an impact. That however was not the case as the SATA drive was right in line with the high-speed NVMe. ## Conclusions In this testing, we found the use of faster storage devices to not improve the performance of learning. The main reason here is a complex structure of the AI model. The time of learning is longer than the time of data reading. Said another way, the time of learning using the current batch of images is longer than the time needed for reading the next one. Consequently, the storage operations are hidden behind the AI computations. When adding in the NVIDIA T4, there was some thought that faster processing by the AI would induce the storage to make an impact in performance. This was not the case in this test, as even with the T4, the AI model still had a heavier learning component and didn’t require storage to be particularly speedy. While more work needs to be done to further test the impact of specific components and systems on AI, we believe this initial data to be useful and a good starting point for the conversation. We need application data to be able to get to a better understanding of where the right levers are from an IT standpoint and where budgetary spend can yield the most impactful results. This of course depends in large part too on where this activity takes place, be it in the data center or edge. For now we welcome the engagement by byteLAKE and others at the tip of the AI spear to help provide useful data to help answer these pressing questions. This is our first AI test but not the last. Mariusz Kolanko, co-founder of byteLAKE, indicated they have been working on a product named [CFD Suite](https://www.bytelake.com/en/cfdsuite) (AI for Computational Fluid Dynamics “CFD” to accelerate solvers) where the deep learning process needs a lot of data for every epoch of training. This model may in fact place a higher load on storage to train models in the Big Data area and might have an impact on the performance of the deep learning processes itself. Ultimately, as with any application, it’s critical to understand the application needs to assign the proper data center resources. AI is clearly not a one size fits all application. [Learn more about byteLAKE](https://www.bytelake.com/en/) [Discuss on Reddit](https://www.reddit.com/r/StorageReview/comments/hgbviz/the_impact_of_storage_and_gpu_on_ai_workloads/) **Engage with StorageReview** [Newsletter](https://www.storagereview.com/storage_newsletter) |  [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast  [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") |  [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") |  [Twitter](https://twitter.com/storagereview "Opens in a new window") |  [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") |  [RSS Feed](https://www.storagereview.com/rss.xml) ![]() ### Brian Beeler Brian is located in Cincinnati, Ohio and is the chief analyst and President of StorageReview.com. Previous post: [ADATA Swordfish M.2 SSD Review](https://www.storagereview.com/review/adata-swordfish-m-2-ssd-review) Next post: [KIOXIA CD6 PCIe 4.0 SSD Review](https://www.storagereview.com/review/kioxia-cd6-pcie-4-0-ssd-review) Trusted Vendors Products and solutions from our affiliate partners: - [ ![Ubiquiti Logo]() Ubiquiti ](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window") - [ ![Newegg Logo]() Newegg ](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window") - [ ![Amazon Logo]() Amazon ](https://amzn.to/4fLJUEW "Opens in a new window") Newsletter Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam! 1 Leave this field empty if you’re human: ## Advertisement Content Categories [Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved. Manage your privacy To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions. Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage your privacy To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage consent Manage consent ```json {"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/review\/the-impact-of-storage-and-gpu-on-ai-workloads","url":"https:\/\/www.storagereview.com\/review\/the-impact-of-storage-and-gpu-on-ai-workloads","name":"The Impact of Storage and GPU on AI Workloads - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/review\/the-impact-of-storage-and-gpu-on-ai-workloads#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/review\/the-impact-of-storage-and-gpu-on-ai-workloads#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/06\/bytelake-eye-logo.jpg","datePublished":"2020-06-26T17:23:46+00:00","dateModified":"2020-06-26T17:25:20+00:00","description":"The main objective of this article is to evaluate the impact of storage and GPU on AI workloads. We've used the fastest flash and an NVIDIA T4 to work","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/review\/the-impact-of-storage-and-gpu-on-ai-workloads#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/review\/the-impact-of-storage-and-gpu-on-ai-workloads"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/review\/the-impact-of-storage-and-gpu-on-ai-workloads#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/06\/bytelake-eye-logo.jpg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/06\/bytelake-eye-logo.jpg","width":1920,"height":638,"caption":"byteLAKE"},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/review\/the-impact-of-storage-and-gpu-on-ai-workloads#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"Review","item":"https:\/\/www.storagereview.com\/review"},{"@type":"ListItem","position":3,"name":"The Impact of Storage and GPU on AI Workloads"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]} ```