--- description: Leading inference providers are using NVIDIA Blackwell platform to achieve token efficiencies. title: Inference Providers Leverage NVIDIA Blackwell to Drive 10x Reduction in Token Costs image: https://www.storagereview.com/wp-content/uploads/2025/10/StorageReview-HPE-ProLiant-DL380a-04.jpg --- [![Storage Review]()](https://storagereview.com/) --- [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [Facebook](https://www.facebook.com/@storagereview) [X (Twitter)](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS Feed](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) [![StorageReview.com](https://www.storagereview.com/wp-content/uploads/2026/07/Storage-Review-2x.png)](https://www.storagereview.com) ≡ Menu - [Home](https://www.storagereview.com/) - [Storage Reviews](https://www.storagereview.com/review) - [End User Reviews](https://www.storagereview.com/consumer) - [Enterprise Reviews](https://www.storagereview.com/enterprise) - [Ubiquiti Reviews](https://www.storagereview.com/best/ubiquiti-reviews) - [SR Merch](https://store.storagereview.com) - [Leaderboards](https://www.storagereview.com/best) - [Best Storage Arrays](https://www.storagereview.com/best/storage-arrays) - [Best Enterprise SSDs](https://www.storagereview.com/best/enterprise-ssds) - [Best Servers](https://www.storagereview.com/best/servers) - [Best Enterprise GPUs](https://www.storagereview.com/best/enterprise-gpus) - [Best Desktops for Local AI](https://www.storagereview.com/best/desktops-local-ai) - [Best Laptops for Local AI](https://www.storagereview.com/best/laptops-local-ai) - [Best Local LLM Tools](https://www.storagereview.com/best/local-llm-tools) - [Agentic AI Hardware](https://www.storagereview.com/best/agentic-ai-hardware) - [Best SSDs & Hard Drives](https://www.storagereview.com/best_drives) - [Best Portable SSDs](https://www.storagereview.com/best/portable-ssds) - [Best Business Laptops](https://www.storagereview.com/best/business-laptops) - [Best Mobile Workstations](https://www.storagereview.com/best/mobile-workstations) - [Best Desktop Workstations](https://www.storagereview.com/best/desktop-workstations) - [Best Mini PCs](https://www.storagereview.com/best/mini-pcs) - [Best Laptop Battery Life](https://www.storagereview.com/best/laptop-battery-life) - [Storage Reference Guide](https://www.storagereview.com/storage-reference-guide) - [About SR](https://www.storagereview.com/about-storagereview) - [StorageReview.com Sweepstakes Rules and Regulations](https://www.storagereview.com/storagereview-com-sweepstakes-rules-and-regulations) Search [Home](https://www.storagereview.com/) » [News](https://www.storagereview.com/news) » Inference Providers Leverage NVIDIA Blackwell to Drive 10x Reduction in Token Costs # Inference Providers Leverage NVIDIA Blackwell to Drive 10x Reduction in Token Costs by Harold Fritts on February 12, 2026 [AI](https://www.storagereview.com/enterprise/ai)  ◇  [Enterprise](https://www.storagereview.com/enterprise) The fundamental unit of intelligence in modern AI interactions is the token. Whether powering clinical diagnostics, interactive gaming dialogue, or autonomous customer service agents, the scalability of these applications depends heavily on tokenomics. Recent MIT Data indicate that advances in infrastructure and algorithmic efficiency are reducing inference costs by up to 10x annually. Leading inference providers, including Baseten, DeepInfra, Fireworks AI, and Together AI, are now using the NVIDIA Blackwell platform to achieve these efficiencies, often outperforming the previous Hopper generation by an order of magnitude. ![](https://www.storagereview.com/wp-content/uploads/2026/02/Storagereview-nvidia-tokens-token-cost.png) **Healthcare Efficiency via Baseten and Sully.ai** In the healthcare sector, administrative burdens such as medical coding and documentation significantly detract from patient care. Sully.ai addresses this by deploying AI agents to automate these routine tasks. Previously, the company faced bottlenecks, including unpredictable latency and inference costs that outpaced revenue growth when using proprietary, closed-source models. ![]() By migrating to Baseten’s Model API, which uses open-source models on NVIDIA Blackwell GPUs, Sully.ai achieved a 90 percent reduction in inference costs. Baseten optimized the stack with the NVFP4 data format, TensorRT-LLM, and the NVIDIA Dynamo inference framework. The transition delivered 2.5x the throughput per dollar compared with Hopper and a 65% improvement in response times. To date, the implementation has reclaimed over 30 million minutes for physicians by automating manual data entry. **Gaming Performance with DeepInfra and Latitude** Latitude, the developer behind AI Dungeon and the Voyage RPG platform, faces unique scaling challenges because every player action requires an inference request. Maintaining seamless gameplay requires low latency and cost-effective token delivery. By running large-scale Mixture-of-Experts (MoE) models on DeepInfra’s Blackwell-powered infrastructure, Latitude has achieved significant cost improvements. ![]() DeepInfra reduced the cost per million tokens from 20 cents on Hopper to 10 cents on Blackwell. By leveraging Blackwell’s native low-precision NVFP4 format, costs were further halved to 5 cents per million tokens. This 4x improvement enables Latitude to deploy more sophisticated models and handle traffic spikes without compromising the user experience or accuracy. **Scaling Agentic Workflows with Fireworks AI and Sentient** Sentient Labs develops open-source reasoning AI systems, such as Sentient Chat, which orchestrates multi-agent workflows. These complex interactions often trigger a cascade of autonomous tasks, resulting in significant infrastructure overhead. Utilizing Fireworks AI’s inference platform on NVIDIA Blackwell, Sentient achieved a 25 to 50 percent increase in cost efficiency over Hopper-based deployments. ![]() The increased throughput per GPU enabled Sentient to handle massive concurrency. During a viral launch phase, the platform processed 1.8 million waitlisted users within 24 hours and managed 5.6 million queries in a single week. The Blackwell-optimized stack maintained consistently low latency despite the high query volume. **Enterprise Voice Support via Together AI and Decagon** Decagon provides AI agents for enterprise customer support, where voice interactions require sub-second response times to remain viable. Together AI hosts Decagon’s multimodel voice stack on NVIDIA Blackwell, implementing optimizations such as speculative decoding and caching of repeated conversation elements. ![]() These technical refinements reduced response times to under 400 milliseconds, even for queries involving thousands of tokens. By combining open-source and in-house models with Blackwell’s hardware-software co-design, Decagon reduced the cost per query by 6x compared to proprietary closed-source alternatives. **The Future of Tokenomics** The transition to NVIDIA Blackwell, particularly the GB200 NVL72 system, marks a shift in how reasoning MoE models are deployed at scale. The platform’s ability to deliver a 10x reduction in cost per token is a result of deep integration across compute, networking, and software layers. Looking ahead, the upcoming NVIDIA Rubin platform is expected to continue this trajectory, delivering a further 10x improvement in performance and token cost efficiency compared with the Blackwell architecture. **Engage with StorageReview** [Newsletter](https://www.storagereview.com/storage_newsletter) |  [YouTube](https://www.youtube.com/user/StorageReview "Opens in a new window") | Podcast  [iTunes](https://podcasts.apple.com/gb/podcast/storagereview-com-storage-reviews/id1060681115 "Opens in a new window")/ [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0 "Opens in a new window") |  [Instagram](https://www.instagram.com/storagereview/ "Opens in a new window") |  [Twitter](https://twitter.com/storagereview "Opens in a new window") |  [TikTok](https://www.tiktok.com/@storagereview? "Opens in a new window") |  [RSS Feed](https://www.storagereview.com/rss.xml) ![]() ### Harold Fritts I have been in the tech industry since IBM created Selectric. My background, though, is writing. So I decided to get out of the pre-sales biz and return to my roots, doing a bit of writing but still being involved in technology. Previous post: [Backblaze 2025 Year-End Drive Stats: Annual AFR Falls to 1.36% as High-Capacity Drives Dominate Fleet](https://www.storagereview.com/news/backblaze-2025-year-end-drive-stats-annual-afr-falls-to-1-36-as-high-capacity-drives-dominate-fleet) Next post: [Micron 9650 NVMe SSD Enters Mass Production as First PCIe Gen6 Enterprise SSD](https://www.storagereview.com/news/micron-9650-nvme-ssd-enters-mass-production-as-first-pcie-gen6-enterprise-ssd) Trusted Vendors Products and solutions from our affiliate partners: - [ ![Ubiquiti Logo](https://www.storagereview.com/wp-content/uploads/2024/11/2-1.webp) Ubiquiti ](https://store.ui.com/us/en?a_aid=StorageReview "Opens in a new window") - [ ![Newegg Logo](https://www.storagereview.com/wp-content/uploads/2025/11/newegg.webp) Newegg ](https://click.linksynergy.com/fs-bin/click?id=g5terNMDhz0&offerid=1207190.18&subid=0&type=4 "Opens in a new window") - [ ![Amazon Logo](https://www.storagereview.com/wp-content/uploads/2025/11/amazon.webp) Amazon ](https://amzn.to/4fLJUEW "Opens in a new window") Newsletter Subscribe to the StorageReview newsletter to stay up to date on the latest news and reviews. We promise no spam! 1 Leave this field empty if you’re human: ## Advertisement Content Categories [Facebook](https://www.facebook.com/@storagereview) [X](https://twitter.com/storagereview) [Instagram](https://www.instagram.com/storagereview/) [LinkedIn](https://www.linkedin.com/company/storagereview-com) [YouTube](https://www.youtube.com/user/storagereview?sub_confirmation=1) [Email](mailto:info@storagereview.com) [Spotify](https://open.spotify.com/show/1y6VnznABhHeOSMOmbDTz0) [Reddit](https://www.reddit.com/r/StorageReview/) [Discord](https://discord.gg/TwMHb4azdC) [RSS](https://www.storagereview.com/rss.xml) [TikTok](https://www.tiktok.com/@storagereview) Copyright © 1998-2025 Flying Pig Ventures, LLC Cincinnati, Ohio. All rights reserved. Manage your privacy To provide the best experiences, we and our partners use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us and our partners to process personal data such as browsing behavior or unique IDs on this site and show (non-) personalized ads. Not consenting or withdrawing consent, may adversely affect certain features and functions. Click below to consent to the above or make granular choices. Your choices will be applied to this site only. You can change your settings at any time, including withdrawing your consent, by using the toggles on the Cookie Policy, or by clicking on the manage consent button at the bottom of the screen. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage your privacy To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions. Functional Functional Always active The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network. Preferences Preferences The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user. Statistics Statistics The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you. Marketing Marketing The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes. Statistics Marketing Features Always active Special features Special purposes Always active - Manage options - Manage services - Manage {vendor\_count} vendors - [Read more about these purposes](https://cookiedatabase.org/tcf/purposes/) Accept Deny Manage options Save preferences Manage options - {title} - {title} - {title} Manage consent Manage consent ```json {"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.storagereview.com\/news\/inference-providers-leverage-nvidia-blackwell-to-drive-10x-reduction-in-token-costs","url":"https:\/\/www.storagereview.com\/news\/inference-providers-leverage-nvidia-blackwell-to-drive-10x-reduction-in-token-costs","name":"Inference Providers Leverage NVIDIA Blackwell to Drive 10x Reduction in Token Costs - StorageReview.com","isPartOf":{"@id":"https:\/\/www.storagereview.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.storagereview.com\/news\/inference-providers-leverage-nvidia-blackwell-to-drive-10x-reduction-in-token-costs#primaryimage"},"image":{"@id":"https:\/\/www.storagereview.com\/news\/inference-providers-leverage-nvidia-blackwell-to-drive-10x-reduction-in-token-costs#primaryimage"},"thumbnailUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2025\/10\/StorageReview-HPE-ProLiant-DL380a-04.jpg","datePublished":"2026-02-12T16:16:12+00:00","description":"Leading inference providers are using NVIDIA Blackwell platform to achieve token efficiencies.","breadcrumb":{"@id":"https:\/\/www.storagereview.com\/news\/inference-providers-leverage-nvidia-blackwell-to-drive-10x-reduction-in-token-costs#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.storagereview.com\/news\/inference-providers-leverage-nvidia-blackwell-to-drive-10x-reduction-in-token-costs"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/news\/inference-providers-leverage-nvidia-blackwell-to-drive-10x-reduction-in-token-costs#primaryimage","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2025\/10\/StorageReview-HPE-ProLiant-DL380a-04.jpg","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2025\/10\/StorageReview-HPE-ProLiant-DL380a-04.jpg","width":1500,"height":975},{"@type":"BreadcrumbList","@id":"https:\/\/www.storagereview.com\/news\/inference-providers-leverage-nvidia-blackwell-to-drive-10x-reduction-in-token-costs#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.storagereview.com\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/www.storagereview.com\/news"},{"@type":"ListItem","position":3,"name":"Inference Providers Leverage NVIDIA Blackwell to Drive 10x Reduction in Token Costs"}]},{"@type":"WebSite","@id":"https:\/\/www.storagereview.com\/#website","url":"https:\/\/www.storagereview.com\/","name":"StorageReview.com","description":"StorageReview.com is a leading provider of news and reviews throughout the entire IT stack - from the datacenter to the edge, and all points in between.","publisher":{"@id":"https:\/\/www.storagereview.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.storagereview.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.storagereview.com\/#organization","name":"StorageReview.com","url":"https:\/\/www.storagereview.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","contentUrl":"https:\/\/www.storagereview.com\/wp-content\/uploads\/2020\/02\/Storage-Reviews-2-2.png","width":344,"height":61,"caption":"StorageReview.com"},"image":{"@id":"https:\/\/www.storagereview.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/storagereview","http:\/\/youtube.com\/user\/storagereview"]}]} ```