Loading page…
The new family gives self-hosted deployments a choice between a smaller tool-capable model and larger variants trained for code, search and other tool-use tasks.
Listen to this story
IBM’s Granite 4.2 expands its self-hosted model lineup with 3B, 8B, and 30B variants, but reserves specialized agentic reinforcement-learning training for the two larger models. That training targets terminal work, code execution, web search, and external tools; the 3B model retains tool calling without the same optimization. All models offer a 128,000-token native context, with IBM citing support up to 512,000 tokens, plus selectable reasoning modes and Apache 2.0 licensing for local deployment.
Only the 8B and 30B models received agentic training in sandboxed terminal, coding, web-search, and tool-use tasks.
The 3B model supports OpenAI-format tool calling, but lacks the larger variants’ specialized agentic training.
Granite 4.2 runs with vLLM or SGLang and supports thinking, non-thinking, and lower-compute modes.
IBM has released Granite 4.2, an open-weight language-model family built for download and self-hosting. The central distinction is not just size: its 8B and 30B models receive specialized training for tool use, while the 3B version does not.
The release spans 3B, 8B and 30B parameter variants, each with a native 128,000-token context window. IBM also says Granite 4.2 can support contexts of up to 512,000 tokens—the stated family maximum, rather than the standard window.
The 8B and 30B variants received agentic reinforcement-learning training for terminal use, web search and external tools. IBM also describes that training as covering code writing and execution, alongside web search, in sandbox environments. The 3B model supports tools, but did not receive the same specialized agentic training.
All Granite 4.2 models support OpenAI-format tool calling and can run on vLLM or SGLang. IBM calls Granite 4.2 the Granite family’s reasoning-focused release; the models can switch between thinking and non-thinking modes, while low-effort mode is intended to conserve resources on simpler queries.
Functional reasoning carries intermediate results through multiple steps. It can produce more rigorous and accurate responses in some cases, but often brings slower response times and higher compute demands. Granite’s selectable modes position that trade-off as a setting organizations can vary by task.
Granite 4.2 is available under the Apache 2.0 license through Hugging Face, Ollama, GitHub and other platforms. IBM also released Granite Speech 5.0 Turbo CTC models with 470 million parameters, claiming they can transcribe three hours of audio in one second.
Loading discussion...
Be the first to share a perspective or an experience.
Reader comments
Newest comments first. Replies stay oldest first.