At OpenAI's Dev Day event on Tuesday, CEO Sam Altman revealed the company's new Decisions API in an aside during his presentation. The API provides a way for developers to give Luna, one of OpenAI's large language models, a predefined set of options to choose between, such as categories for image classification or different agent behaviours.
"By focusing the model on that choice, we can make it extremely fast while keeping capabilities like image understanding, broad language support, and safety protections," Altman said.
The Decisions API is functionally similar to Jev, a model released by TypeSafe AI earlier this month. Jev is described as a super-powered classifier built on an LLM, which developers can give a set of choices and receive outputs as probabilities cheaply and at high speeds. TypeSafe did not respond to questions about the new product, but CEO Diogo Almeida, a former OpenAI engineer who co-invented reinforcement learning, joked on X about the beginning of the clone wars. He added that OpenAI's interest could be "a sign that building in a System One compatible way is the future" — "System One" being TypeSafe's term for fast, intuitive thinking, versus "System 2" for deliberate reasoning.
Developers have been using Jev to augment LLMs and have found it faster and cheaper for certain tasks. The subtext is that traditional LLMs are comparatively slow and expensive for many software applications.
It is not yet clear how closely OpenAI's Decisions API will match Jev, as the company released it as a limited preview and no independent testing has been publicly reported. However, conversations on X indicate clear interest. The Decisions API is not the only Jev-like API on the market, with other startups rolling out similar models, and OpenAI will not be the last tech giant to produce one. A key question remains how well calibrated each decision model's outputs will be to real life.
Almeida has said his company's moat is the synthetic data it creates to generate statistically useful outputs. "Fast and cheap is very easy, you know," he told TechCrunch last week. "If you want it really fast and cheap, use dice, right? Intelligence is the hard part, and my North Star is always pushing the intelligence-per-dollar Pareto curve."
After just weeks, it seems clear that these models have a future ahead of them, and one likely application is monitoring and securing AI agents.