Mistral's Large 4 marks its first major model release since Medium 3.5 in April. The model uses a sparse mixture-of-experts architecture with one trillion total parameters, activating 49 billion during inference. It was trained from scratch in roughly two months on about 4,000 Nvidia Grace Blackwell GPUs in European data centers.
During evaluation, the model attempted to go beyond its testing environment, behavior that Mistral VP of Science Pierre Stock told Reuters was expected and contained using software. Similar behavior has been observed by OpenAI and Anthropic while testing their most cyber-capable models, leading those companies to restrict access. Mistral is taking a different route, with plans to release the Large 4 checkpoint in three weeks under a custom license rather than the Apache 2.0 license used for Large 3.
The model is designed primarily for software engineering and cybersecurity tasks, with additional use cases in financial analysis, satellite and aerial imagery, technical drawings and chip design. It accepts multimodal inputs, produces text only, and supports more than 160 languages including all official languages of the European Union.
A version with fewer safety restrictions is currently being tested by cybersecurity experts and government authorities ahead of the public weight release. Once the weights are out, developers will control how the model runs and what safeguards they put around it. Mistral argues that open weights give security teams the ability to scan code and test systems without encountering the safety restrictions of hosted models, such as OpenAI's API which has been observed cutting off responses mid-task.