Microsoft moves AI inference toward its own chips
SignalBetaWhat the people building AI said today
Microsoft said it will make Maia its primary inference system, while Meta introduced two Muse models that it describes as frontier class.
Microsoft puts Maia at its inference core
Microsoft announced its Maia 300 accelerator, which it says delivers 40 percent more inference tokens per megawatt than leading GPU-based systems. Satya Nadella said Microsoft will scale Maia to multi-gigawatt deployments next year and make it the primary inference system for its products and services.
Starting next calendar year, we will scale our Maia family to multi-gigawatt deployments, making it the primary inference system for our own product and services.
Satya Nadella, Microsoft CEO · On XBuilding on the magic of Maia 200, it delivers 40% more inference tokens per megawatt compared to leading GPU-based systems, and up to 7x the rack-scale token throughput of Maia 200.
Microsoft, Microsoft · On XOur story: Microsoft to shift AI workloads to homegrown Maia chips, easing reliance on Nvidia
Meta releases Muse Wonder models
Alexandr Wang, Shengjia Zhao, AI at Meta and 1 more
Signal: what the people building AI and technology said on X today, from the accounts the desk follows. Our words set the scene; theirs are quoted exactly, with a link to each post. Signal is in beta: the format is still changing, and we would like to hear what you think at editor@zot.news.
§