--- description: "VAST Data expands its AMD collaboration: 6th Gen EPYC CBox/EBox, a Helios reference architecture, and 9x faster TTFT via KV cache offload." title: VAST Data and AMD Claim 9x Faster Time-to-First-Token With KV Cache Offload on Instinct image: https://www.storagereview.com/wp-content/uploads/2022/03/StorageReview-VAST-Ceres-KIOXIA-Flash.jpg --- [![Storage Review]()](https://storagereview.com/) --- [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [![StorageReview.com](https://www.storagereview.com/wp-content/uploads/2026/07/Storage-Review-2x.png)](https://www.storagereview.com) ≡ Menu - [Home](https://www.storagereview.com/) - [Storage Reviews](https://www.storagereview.com/review) - [End User Reviews](https://www.storagereview.com/consumer) - [Enterprise Reviews](https://www.storagereview.com/enterprise) - [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews) - [SR Merch](https://store.storagereview.com) - [Leaderboards](https://www.storagereview.com/best) - [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays) - [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds) - [Best Servers](https://www.storagereview.com/best/servers) - [Best Enterprise GPUs](https://www.storagereview.com/best/enterprise-gpus) - [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai) - [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai) - [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools) - [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware) - [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives) - [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds) - [Best Business Laptops](https://www.storagereview.com/best/business-laptops) - [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations) - [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations) - [Best Mini PCs](https://www.storagereview.com/best/mini-pcs) - [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life) - [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide) - [About SR](https://www.storagereview.com/about-storagereview) - [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations) Search [Home](https://www.storagereview.com/) » [News](https://www.storagereview.com/news) » VAST Data and AMD Claim 9x Faster Time-to-First-Token With KV Cache Offload on Instinct # VAST Data and AMD Claim 9x Faster Time-to-First-Token With KV Cache Offload on Instinct by Harold Fritts on July 27, 2026 [AI](https://www.storagereview.com/enterprise/ai)  ◇  [Enterprise](https://www.storagereview.com/enterprise) VAST Data has expanded its collaboration with AMD around AI infrastructure for cloud providers and enterprises deploying training, inference, retrieval-augmented generation, and agentic AI services. The effort combines the VAST AI Operating System with [6th Gen AMD EPYC processors](https://www.storagereview.com/news/amd-6th-gen-epyc-venice-256-cores-1-6tb-s-and-the-first-pcie-gen-6-server-cpu), AMD Instinct GPUs, AMD networking hardware, and ROCm software. The collaboration reflects a broader infrastructure shift from training-focused AI clusters toward environments that must also support persistent context, high-concurrency inference, and multi-turn agent workflows. These deployments place increased emphasis on data movement, KV cache management, GPU utilization, and the ability to deliver low-latency access to large model and context datasets. VAST positions its [Disaggregated Shared Everything, or DASE](), architecture as the shared data layer for these environments. The platform combines file and object storage, databases, event streaming, and data services under a unified global namespace. It also provides multi-tenancy and workload isolation capabilities for AI clouds operating concurrent customer and application workloads. ### EPYC 9006 Platforms for VAST CBox and EBox Systems VAST has selected 6th Gen AMD EPYC processors, formerly codenamed Venice, for its next-generation CBox and EBox platforms. The company plans to use the processors in its sixth-generation CBox and third-generation EBox systems, which underpin the VAST AI Operating System. [AMD EPYC 9006](https://www.storagereview.com/news/amd-6th-gen-epyc-venice-256-cores-1-6tb-s-and-the-first-pcie-gen-6-server-cpu) support introduces PCIe Gen6 connectivity to the VAST hardware platform. VAST states that the new interface doubles generational I/O bandwidth, improving file and object storage throughput while reducing latency for data services such as databases, data warehouses, and event-streaming workloads delivered through VAST DataBase and DataEngine. For AI infrastructure, higher I/O bandwidth can help reduce bottlenecks between compute, network, and NVMe storage resources. This is particularly relevant for model loading, retrieval pipelines, checkpoint access, and externalized KV cache workflows where GPU memory capacity alone is insufficient to retain active context. ### Reference Architecture Combines Helios, VAST, and DriveNets VAST, AMD, and [DriveNets](https://www.storagereview.com/news/whitefibers-project-redwood-links-two-h200-clusters-into-one-111-2-tbps-supercluster) are also developing an AI infrastructure reference architecture built around AMD Helios rack-scale AI infrastructure, the VAST AI Operating System, and DriveNets AI Fabric networking. ![]() The reference architecture is intended to provide deployment guidance for model training, inference, reinforcement learning, and KV cache workloads. It includes sizing and availability considerations for organizations building AI factories that require shared data infrastructure and high-performance networking alongside GPU compute. VAST also cited expanded collaboration with inference software providers TensorMesh and EmbeddedLLM. The ecosystem effort is focused on production inference architectures for agentic AI applications, although specific product integrations and availability details were not disclosed. ### KV Cache Offload Targets High-Concurrency Inference A central component of the announcement is expanded [KV cache]() support using [AMD Instinct GPU]()s, AMD Infinity Context, ROCm software, and the VAST AI Operating System. ![AMD instinct MI355]() KV cache data stores intermediate attention-state information generated during inference. Retaining this data improves performance for multi-turn interactions and long-context workloads, but large cache footprints can consume significant GPU memory. Externalizing or tiering KV cache to a high-performance storage platform can free GPU memory for active workloads while retaining context for subsequent inference requests. VAST reported early testing with an [AMD Instinct MI355X GPU](https://www.storagereview.com/review/supermicro-jumpstart-review-h14-with-amd-instinct-mi350x) that showed a 9x improvement in time to first token and 9.7x higher token throughput when using VAST for KV cache offload in high-concurrency agentic AI workloads. The company noted that these results depend on the hardware baseline, workload characteristics, and storage configuration. The integration also applies VAST lifecycle policies to KV cache data. This capability is intended to automatically expire and delete cached information, which is relevant when the inference context contains sensitive, personal, or regulated data. ### Pensando Pollara 400 Connects GPUs to Shared Storage The architecture uses the [AMD Pensando Pollara 400 AI NIC](https://www.storagereview.com/news/supermicro-h15-servers-pair-6th-gen-epyc-with-mi350p-gpu-systems-and-the-helios-rack) to connect AMD Instinct GPUs with the VAST storage cluster. According to VAST, the NIC supports GPU-to-storage data movement through NFS over TCP and RDMA, enabling access to NVMe SSD-based VAST clusters for KV cache and broader inference data requirements. ![]() The resulting design is intended to support AI environments that need to scale context management independently of GPU memory. Rather than treating storage as a separate persistence layer, VAST is positioning the platform as a data and execution layer that can manage models, databases, streaming data, file data, and AI context across distributed infrastructure. For AI cloud providers, the approach targets higher GPU utilization and improved operational efficiency as deployments move beyond GPU rental and batch training into persistent inference and agentic AI services. **Engage with StorageReview** [Newsletter](https://www.storagereview.com/storage_newsletter) |  [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast  [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") |  [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") |  [Twitter](https://twitter.com/storagereview "Opens in a new window") |  [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") |  [RSS Feed](https://www.storagereview.com/rss.xml) ![]() ### Harold Fritts I have been in the tech industry since IBM created Selectric. My background, though, is writing. So I decided to get out of the pre-sales biz and return to my roots, doing a bit of writing but still being involved in technology. Previous post: [Wistron’s $700M Fort Worth Plant Becomes the First U.S. Site Building NVIDIA GB300 Superchips](https://www.storagereview.com/news/wistrons-700m-fort-worth-plant-becomes-the-first-u-s-site-building-nvidia-gb300-superchips) Next post: [ASUS Builds Its EPYC 9006 Server Line on AMD’s Efficiency-Optimized SP8 Socket](https://www.storagereview.com/news/asus-builds-its-epyc-9006-server-line-on-amds-efficiency-optimized-sp8-socket) Trusted Vendors Products and solutions from our affiliate partners: - [ ![Ubiquiti Logo](https://www.storagereview.com/wp-content/uploads/2024/11/2-1.webp) Ubiquiti ](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window") - [ ![Newegg Logo](https://www.storagereview.com/wp-content/uploads/2025/11/newegg.webp) Newegg ](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window") - [ ![Amazon Logo](https://www.storagereview.com/wp-content/uploads/2025/11/amazon.webp) Amazon ](https://amzn.to/4fLJUEW "Opens in a new window") Newsletter Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam! 1 Leave this field empty if you’re human: ## Advertisement Content Categories [Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved. Manage your privacy To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions. Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage your privacy To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage consent Manage consent ```json {"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/news\/vast-data-and-amd-claim-9x-faster-time-to-first-token-with-kv-cache-offload-on-instinct","url":"https:\/\/www.storagereview.com\/news\/vast-data-and-amd-claim-9x-faster-time-to-first-token-with-kv-cache-offload-on-instinct","name":"VAST Data and AMD Claim 9x Faster Time-to-First-Token With KV Cache Offload on Instinct - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/news\/vast-data-and-amd-claim-9x-faster-time-to-first-token-with-kv-cache-offload-on-instinct#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/news\/vast-data-and-amd-claim-9x-faster-time-to-first-token-with-kv-cache-offload-on-instinct#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2022\/03\/StorageReview-VAST-Ceres-KIOXIA-Flash.jpg","datePublished":"2026-07-27T15:18:22+00:00","description":"VAST Data expands its AMD collaboration: 6th Gen EPYC CBox\/EBox, a Helios reference architecture, and 9x faster TTFT via KV cache offload.","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/news\/vast-data-and-amd-claim-9x-faster-time-to-first-token-with-kv-cache-offload-on-instinct#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/news\/vast-data-and-amd-claim-9x-faster-time-to-first-token-with-kv-cache-offload-on-instinct"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/news\/vast-data-and-amd-claim-9x-faster-time-to-first-token-with-kv-cache-offload-on-instinct#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2022\/03\/StorageReview-VAST-Ceres-KIOXIA-Flash.jpg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2022\/03\/StorageReview-VAST-Ceres-KIOXIA-Flash.jpg","width":1500,"height":1049},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/news\/vast-data-and-amd-claim-9x-faster-time-to-first-token-with-kv-cache-offload-on-instinct#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.storagereview.com\/news"},{"@type":"ListItem","position":3,"name":"VAST Data and AMD Claim 9x Faster Time-to-First-Token With KV Cache Offload on Instinct"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]} ```