Google launches LiteRT Tensor API for on-device machine learning
New C++ API allows developers to build and optimize ML models for CPU, GPU, and NPU without backend rewrites
Google has introduced the LiteRT Tensor API, a lightweight C++ API that lets developers build, customise, and optimise machine learning models for on-device execution across CPU, GPU, and NPU hardware without requiring separate rewrites for each backend.