OpenAI has made its Decisions API available to all customers, its first wide release in a fast-growing market for small, low-cost AI models built to make quick choices rather than generate long text.
TypeSafe, a startup founded by a former OpenAI researcher, effectively created the category with its Jev model, and the niche helped make the company worth $7.6 billion. These "decision" or "System One" models act as super classifiers: given a set of options, they return a choice and a confidence rating in milliseconds, at a fraction of the cost of full-sized large language models. Developers have found they can replace LLMs in many workflows with faster, cheaper results.
Nikunj Handa, product lead for OpenAI's APIs, said his colleagues saw Jev and reacted with, "wow, we have like a million use cases for this." Rather than build a specifically calibrated decision model, the team took ChatGPT Luna and reconfigured it to speed up inference and cut cost. "The big unlock with Decisions API has been the speed, shrinking things from one to three seconds to 100, 120, 180 milliseconds," Handa said. "Right now, it's just plain old Luna that gets the job done."
Announced at OpenAI's developer day on September 29, the API became generally available this week, adding voice and visual modalities and targeting inference resources geographically to lower latency around the world. Early trials with customers including Box, Datadog, Ramp and Speak used the API to replace LLMs with higher throughput. Andrew Hsu, chief technology officer at AI language tutor company Speak, said the API cut the time between actions from 1.4 seconds to 0.13 seconds.
Competition is fierce. Public benchmarks such as the AIM System One Index and the Artificial Analysis Decision Index currently favor D1 Ultra, a decision model Liquid released last week, and Base Lab's Elephant-1. The latest Jev model ranks seventh and third on those indices, while OpenAI's model sits eighth and fourteenth. Still, TypeSafe's offerings remain the most widely queried on the OpenRouter routing service.
TypeSafe chief executive Diogo Almeida distrusts benchmarks and urges customers to trial models in their own work. The most playful test, JevMan, has decision models play PacMan, and the latest Jev model tops that ranking. Felix Wunderlich, chief growth officer at Opper AI, which built the benchmark, said PacMan "is an interesting test because of its nonstop stream of quick, high-stakes decisions."
OpenAI's argued advantage is multimodality. Handa said Luna "is extremely powerful and has been showing better calibrations" on image classification, and customers want image outputs as well. He sees further speed gains ahead, asking whether responses could reach 60 milliseconds, which would allow an API call for every frame of a video.
The model's namesake is the economist William Stanley Jevons, who observed that using a resource more efficiently tends to make it more widely used. Handa expects an expanding "crazy set of use cases" that were hiding in plain sight until decision models revealed them.
