company

RadixArk

Technology startup

AI · Meta deploys Google TPUs for AI inference, deepening Nvidia rivalry

Meta has confirmed it is running Google's tensor processing units (TPUs) in production for AI inference, using new PyTorch-native versions of the SGLang and vLLM inference engines. The move, announced on Google's developer blog, follows a three-way collaboration between Meta, Google and startup RadixArk, and comes a day after Amazon open-sourced its own PyTorch backend for its Trainium chips. Both developments aim to loosen Nvidia's software lock-in on AI hardware.