DeepInfra has opened a new AI data center in Toronto, marking the company’s first deployment outside the United States and its ninth facility overall. Announced July 8, the site expands DeepInfra’s global inference infrastructure as demand shifts from AI model training toward production inference workloads.
The Toronto facility provides 1.7 MW of capacity and will host more than 1,000 NVIDIA Blackwell B300 GPUs. Once operational, the cluster will increase DeepInfra’s global inference capacity while reducing latency for customers in Canada and other international markets.
The expansion reflects a broader industry trend. As enterprises move generative AI applications into production, infrastructure demand is increasingly centered on inference rather than training. Large language model inference requires sustained GPU availability, low-latency networking, and geographically distributed infrastructure to support interactive applications, AI agents, and high-volume API services. McKinsey & Company research cited in the announcement projects inference will account for more than 40% of total data center demand by 2030, growing at an estimated 35% compound annual rate.
DeepInfra said the Toronto deployment is designed to address those requirements by bringing GPU resources closer to users and data while increasing overall platform capacity. The company owns and operates its GPU infrastructure, supports more than 200 open-source models, and says it processes nearly five trillion tokens per week across its managed inference platform, which serves both open and proprietary AI models.
The deployment also highlights the growing adoption of NVIDIA’s Blackwell architecture for inference infrastructure. Blackwell GPUs are designed to improve inference throughput and energy efficiency for large language models and multimodal AI workloads compared to previous Hopper-based systems. While DeepInfra did not disclose additional infrastructure details such as networking or storage architecture, deployments at this scale typically rely on high-bandwidth interconnects and distributed storage to keep GPUs fully utilized.
According to CEO and co-founder Nikola Borisov, enterprise AI has shifted from experimentation to production deployments, increasing the need for globally distributed infrastructure that delivers lower latency and scalable inference capacity. He said the Toronto cluster represents the company’s first expansion beyond the U.S. and positions compute resources closer to customers and their data.
The Toronto deployment follows DeepInfra’s recent Series B funding and forms part of the company’s broader infrastructure expansion strategy. The company indicated that additional international data center deployments are under consideration as demand for GPU-based inference services continues to grow.
Amazon