Vultr deploys AMD Instinct MI325X GPUs, expanding AI power to the edge
Vultr, a privately-held global GPU cloud infrastructure provider announced the deployment of AMD Instinct MI325X GPUs in its Chicago data center, becoming the first cloud provider to offer these advanced AI solutions.
The AMD Instinct MI325X GPUs are optimized for AI inference at the edge, featuring 256GB of HBM3E memory and 8 TB/s memory bandwidth, enabling high performance and efficiency for AI tasks. Offering robust AI processing power closer to end-users, this proximity reduces latency, enabling real-time data processing essential for edge computing applications such as autonomous vehicles, IoT devices, and smart city infrastructures.
These GPUs support seamless integration with AMD ROCm open software and are compatible with AMD Instinct MI300X, simplifying deployment for AI and high-performance computing frameworks. Enabling developers to create applications that can operate efficiently both in centralized cloud environments and at the edge.
Vultr’s collaboration with AMD allows businesses to build and scale AI-native applications with robust, cost-efficient, and scalable cloud infrastructure that can also be extended to edge devices. Enterprises can develop and train AI models in the cloud and then deploy them to edge locations, ensuring consistent performance across distributed networks.
“Designed for exceptional performance and efficiency, the AMD Instinct MI325X accelerators excel in demanding AI tasks such as foundation model training, fine-tuning, and inferencing,” says Negin Oliver, corporate vice president of business development, Data Center GPU Business Unit, AMD. “With the addition of the AMD Instinct MI325X, Vultr is empowering businesses with cutting-edge AI technology to harness the necessary computational power and efficiency to drive AI advancement and accelerate growth.”
The GPUs are designed for demanding AI tasks, including foundation model training, fine-tuning, and inferencing, offering exceptional price-to-performance.
Vultr recently secured growth financing at a $3.5 billion valuation, further expanding its global cloud infrastructure capabilities.
The deployment highlights Vultr’s commitment to offering GPUaaS with cutting-edge AI technology to drive innovation and growth for enterprises worldwide.
Comments