IBM’s new Granite 4.2 models represent a deliberate continuation of the company’s strategy to build trustworthy, enterprise-grade AI. By sticking with a dense decoder-only architecture, IBM aims to offer predictable inference behavior — a key requirement for regulated industries such as finance, healthcare, and legal. The 512,000-token context window allows the models to process large documents, codebases or conversation histories in a single pass, reducing the need for complex retrieval-augmented generation pipelines.
Frederic Lardinois of The New Stack reported the details. The larger versions of Granite 4.2 have been specifically trained for agentic work — meaning they can plan, use tools, and execute multi-step tasks autonomously. This aligns with the industry trend toward AI agents that can take actions on behalf of users, a space where IBM is competing with offerings from Microsoft, Google and startups like Adept.
The decision to remain decoder-only is notable at a time when many leading AI labs have shifted to mixture-of-experts (MoE) models, which activate only subsets of parameters per token to achieve higher capacity at lower computational cost. IBM argues that dense models offer more consistent latency and memory usage — characteristics that matter in production environments where service-level agreements must be met. Cryptic references in IBM’s documentation suggest the company has also made improvements to inference efficiency, though exact performance metrics have not been disclosed.
In a blog post accompanying the release, IBM Research highlighted that Granite 4.2 was trained on a curated mix of enterprise data, code, and scientific literature. The model family includes variants optimized for different hardware backends, including IBM’s own Telum chips for on-premises deployments and cloud instances from major providers. Licensing is expected to follow IBM’s previous approach of offering a permissive open-source license for smaller models and commercial terms for larger ones.
The launch comes amid a cooling of the generative AI hype cycle, with enterprises increasingly demanding demonstrable return on investment from AI deployments. IBM’s focus on reliability, auditability and domain-specific fine-tuning may appeal to organizations that have been burned by black-box API services. However, Granite models have yet to achieve the widespread developer adoption seen with Meta’s Llama or Mistral’s offerings, and IBM faces an uphill battle in gaining mindshare among AI practitioners.