Microsoft CEO Satya Nadella announced at the Microsoft AI Tour in Bengaluru that OpenAI’s ChatGPT is the largest user of Cosmos DB, Microsoft’s database service designed for building scalable, AI-enabled apps. I made it clear.
“If you look at ChatGPT, they are one of the biggest users of Cosmos because they function as a stateful application,” Nadella said. This highlights Cosmos DB’s role in managing the extensive real-time interaction and session data required by ChatGPT, a chatbot that handles millions of concurrent conversations.
Nadella highlighted cloud-native databases such as Cosmos DB, SQL Hyperscale, and Fabric for modern AI workloads. He said AI does not exist in isolation but relies on a comprehensive computing stack to function effectively.
Cosmos DB’s scalable architecture supports high-throughput, low-latency requests for both AI training and inference, ensuring responsive, stateful interactions for applications like ChatGPT.
Nadella connected advances in AI to Moore’s Law, noting that the law of scaling remains strong for both training and inference, and highlighting the importance of computing during testing. For test-time computing, databases like Cosmos DB need to handle high-throughput, low-latency requests after training.
He pointed out that consolidating operational and analytical data in the cloud allows AI-driven apps to access large amounts of data reliably and in real-time.
Nadella attributed ChatGPT’s success to the fundamental role of databases in AI, noting that Cosmos DB unifies operational and analytical data to provide reliable, high-volume access in real time.
The company said its focus on robust data infrastructure aligns with its broader strategy, which includes a $3 billion investment in Azure data centers across India, to meet growing demand for AI. and expanding global capacity to respond.
These investments strengthen Cosmos DB’s position as the backbone of next-generation AI applications.
At last year’s Microsoft Build, the company introduced Microsoft Fabric, real-time intelligence, to its AI analytics platform. This update integrates SQL Server with Fabric database to unify operational and analytical data within a single unified platform. Additionally, the data API builder for Azure Cosmos DB is now generally available. This open-source tool requires no coding to set up secure GraphQL endpoints.
