Almeida left OpenAI two years ago to found TypeSafe AI, driven by frustration with the limitations of large language models (LLMs) for automation. 'We have lightning in a bottle, and yet it is not useful,' Almeida told TechCrunch. 'The problem is we are optimizing for human language … We have been super good at human language for four years, but it’s not useful for automation because computers speak a different language.'
Jev is a transformer model — the same architecture underpinning most modern LLMs — but it does not output text. Instead, users define the outputs in advance, and the model returns probabilities. This design makes output tokens free, while input tokens are billed by the billion rather than the million. Because the output space is constrained, the model cannot hallucinate, and it runs inexpensively and quickly.
The model appears most useful for software automation. Pranit Sharma, a software engineer at Vercel, said on social media that his company had previously used OpenAI's ChatGPT Luna 5.6 to run a classifier for reviewing command safety. When Vercel replaced Luna with Jev, it got results 5 to 18 times more quickly, according to Sharma.
TypeSafe AI's release has generated significant developer interest. The company briefly experienced API outages as engineers rushed to test the model. Jev is now generally available through the company's API.