It feels like every week we are getting new, multi-billion dollar partnership announcements from OpenAI and today, it’s Amazon’s turn.
Since Microsoft’s big $10 Billion investment in OpenAI a couple of years ago, ChatGPT and other OpenAI services have enjoyed the benefits of the Azure infrastructure, but such is the demand for generativeAI that OpenAI are going multi-cloud.
Amazon Web Services (AWS) and OpenAI announced a multi-year, strategic partnership that provides AWS’s world-class infrastructure to run and scale OpenAI’s core artificial intelligence (AI) workloads starting immediately.
Under this new $38 billion agreement, which will have continued growth over the next 7 years, OpenAI is accessing AWS compute comprising hundreds of thousands of state-of-the-art NVIDIA GPUs, with the ability to expand to tens of millions of CPUs to rapidly scale agentic workloads.
AWS has lots of experience running large-scale AI infrastructure securely, reliably, and at scale, with clusters topping 500K chips.
– Advertisement –
AWS’s leadership in cloud infrastructure combined with OpenAI’s advancements in generative AI is expected to help millions of users continue to get value from ChatGPT.
The rapid advancement of AI technology has created unprecedented demand for computing power. As frontier model providers seek to push their models to new heights of intelligence, they are increasingly turning to AWS due to the performance, scale, and security they can achieve.
OpenAI will immediately start utilizing AWS compute as part of this partnership, with all capacity targeted to be deployed before the end of 2026, and the ability to expand further into 2027 and beyond.
The infrastructure deployment that AWS is building for OpenAI features a sophisticated architectural design optimized for maximum AI processing efficiency and performance.
Clustering the NVIDIA GPUs both GB200s and GB300s, via Amazon EC2 UltraServers on the same network enables low-latency performance across interconnected systems, allowing OpenAI to efficiently run workloads with optimal performance.
The clusters are designed to support various workloads, from serving inference for ChatGPT to training next generation models, with the flexibility to adapt to OpenAI’s evolving needs.
“Scaling frontier AI requires massive, reliable compute. Our partnership with AWS strengthens the broad compute ecosystem that will power this next era and bring advanced AI to everyone.” – OpenAI co-founder and CEO Sam Altman.
“As OpenAI continues to push the boundaries of what’s possible, AWS’s best-in-class infrastructure will serve as a backbone for their AI ambitions, The breadth and immediate availability of optimized compute demonstrates why AWS is uniquely positioned to support OpenAI’s vast AI workloads.” – said Matt Garman, CEO of AWS.
Earlier this year, OpenAI open weight foundation models became available on Amazon Bedrock, bringing these additional model options to millions of customers on AWS.
OpenAI has quickly become one of the most popular publicly available model providers in Amazon Bedrock with thousands of customers including Bystreet, Comscore, Peloton, Thomson Reuters, Triomics, and Verana Health, working with their models for agentic workflows, coding, scientific analysis, mathematical problem-solving, and more.
For more information on OpenAI’s open weight models in Amazon Bedrock, head to
About the Author
