At DigitalOcean, we’re constantly striving to equip developers and digital native enterprises with the most powerful and accessible tools to fuel AI innovation. Following the introduction of our AMD Instinct™ MI300X GPU Droplets last month, we’re thrilled to announce the availability of the next generation of AI accelerators - AMD Instinct™ MI325X.
Built on the advanced AMD CDNA™ 3 architecture, the AMD Instinct™ MI325X accelerators are engineered to deliver exceptional performance for AI workloads, including large model training, fine-tuning, inference, and high-performance computing (HPC). These GPUs are available as GradientAI GPU Droplets, powerful virtual machines with a simplified setup.
Key benefits of the AMD Instinct™ MI325X that enable you to accelerate complex computations, ensure your inference tasks run faster, and provide more flexibility and control:
Memory capacity and bandwidth: With 256GB of HBM3E memory and 6.0TB/s of bandwidth, the MI325X can hold massive models entirely in memory, significantly reducing the need for model splitting across GPUs and accelerating complex computations. This represents a substantial leap in memory capabilities, offering 1.8x more capacity and 1.3x more bandwidth compared to previous generations.
Accelerated AI inference performance: The MI325X boasts 1.3x greater peak theoretical FP16 and FP8 compute performance than competing solutions, ensuring your AI models run faster and more efficiently, especially for inference tasks.
ROCm™ Software Platform: The MI325X fully leverages the AMD ROCm™ open software platform, enabling developers to build and deploy powerful HPC and AI systems. This open ecosystem empowers you with the flexibility and control you need.
Integrating AMD Instinct™ MI325X GPUs into the DigitalOcean ecosystem means you’ll continue to benefit from the simplicity, affordability, and scalability you’ve come to expect:
Simplified Deployment: Our intuitive platform makes it easy to provision and manage your AI infrastructure, allowing you to focus on developing your applications rather than managing complex setups.
Cost-Effectiveness: These GPUs start at $1.69/GPU/hr (through a contract) and we offer flexible configurations (including single and eight GPU options), helping you optimize costs for your specific use cases.
Seamless Integration: Leverage the MI325X GPU Droplets with your existing DigitalOcean projects, integrating with our Kubernetes service.
Reliability: Benefit from enterprise-grade SLAs, HIPAA-eligibility and SOC 2 compliance, and the peace of mind that comes with building on DigitalOcean’s trusted cloud infrastructure.