Granite 4 350M Dense
An IBM instruction model for business text, private-document workflows and tools. Hybrid variants use a different architecture and need a compatible current runtime.
Exact local Ollama manifest and configuration checked on 2026-10-20. Memory figures are conservative planning estimates; no DeviceTerra inference or speed test is claimed. Hybrid -h profiles use Mamba2; non-h profiles are alternative architectures. Context is registry artifact limit, not guaranteed context on consumer hardware.
- Official model source
- Official engine artifact
Will it run?
MamiLens uses 9 GB as a conservative planning floor for this profile and its listed quantization. This is not measured speed. Processor, backend support, context length, memory bandwidth and other applications still affect the result.
Check your complete system →What is it useful for?
Suggested Ollama artifact
Confirm the tag on the official page before downloading, then run:
ollama run granite4:350mStart with a representative non-sensitive task. Record the exact runtime, quantization, context, load time, generation speed, memory use and answer quality.
Evidence and limits
Published context: 32K artifact maximum; practical context depends on memory. The source establishes specifications; it does not guarantee that maximum context fits at the MamiLens minimum RAM floor.