Yotta Data Services today announced a collaboration with NVIDIA to deliver cutting-edge GPU computing infrastructure and platforms for its Shakti Cloud platform. The collaboration will advance the development of AI solutions in India by bringing state-of-the-art AI capabilities within reach of numerous organizations, businesses, AI researchers, and a multitude of startups across the country. With this offering, Yotta customers will be able to train large language models (LLMs) and other AI workloads serving the growing needs of Indian, Asian, and broader global markets.
Yotta has already placed a large order for NVIDIA H100 Tensor Core GPUs, a powerful GPU for AI and HPC workloads, and plans to go operational with 4096 GPUs by January 2024 and 16,384 GPUs by June 2024. With complete support from NVIDIA and a shared vision to develop India's sovereign AI landscape, Yotta also plans to massively scale up its GPU stable to 32,768 by the end of 2025. This will directly address the huge demand for high-performance GPUs by research labs, enterprises, and startups for HPC and AI workloads.
With this collaboration, Yotta becomes the first NVIDIA Partner Network cloud partner (NCP) in India and joins the global NCP list as an Elite Partner.
Further, Yotta is deploying an NVIDIA-powered reference architecture with NVIDIA InfiniBand networking that will allow GPU clusters to deliver great performance at scale for large AI training and inferencing workloads, as well as HPC workloads.