Microsoft plans huge deployment of its own AI chips, with an eye on saving costs
MSFT•Microsoft plans to deploy potentially more than 1 million Maia 300 AI chips next year. It says the chips deliver about 40% more computing per megawatt than leading GPU-based systems.
1. Maia 300 deployment plans
Microsoft announced its third-generation custom AI chip, Maia 300, and plans to roll out multi-gigawatt deployments starting next year, potentially deploying more than 1 million chips to support its internal AI services. The chips are designed for AI tasks such as coding and carrying out complex business tasks.
2. Chip and rack details
Each rack will hold 96 Maia 300 chips and use about 167 kilowatts of power, compared with 142 kilowatts for Nvidia’s latest GB300 racks, which hold 72 GPUs. Microsoft said Maia 300 delivers about 40% more useful computing per megawatt than leading GPU-based systems, without naming the systems used for comparison. The processor uses chiplets, including key computing components made with Taiwan Semiconductor Manufacturing Co’s 2-nanometer technology.
