Inkling 2 Mini
multimodal model with looped architecture
2 min read
Inkling 2 Mini by Thinking Machines Lab is a versatile multimodal model that takes text and image inputs and generates text outputs. It is designed for developers building AI agents, chatbots, coding tools, and Retrieval-Augmented Generation (RAG) systems. The model is built on a 24-layer decoder featuring sparse Mixture-of-Experts (MoE) layers, where middle layers are executed multiple times to boost efficiency. It supports a context window of up to 1 million tokens and excels at complex programming and data analysis tasks.
Key features
- Multimodal input: support for text and images with resolutions from 40 to 4096 pixels.
- MoE architecture: 26.4 billion total parameters, with about 3.4 to 5.4 billion active per token thanks to looped layers.
- Massive context: native support for a context window of up to 1M tokens.
- Coding support: strong results in automated development and terminal tasks.
What you can do
- Integrate the model into chatbots and assistants to handle text and visual instructions.
- Use it for code generation, debugging, and autonomous programming tasks.
- Set up long-context retrieval-augmented generation (RAG) and information extraction systems.
Example
An example of setting up or running the model using Python libraries or via the Tinker API is available in the official repository and project documentation.
Read more
DetailsBenchmarks: DeepSWE v1.1 — 48.2%, Terminal Bench v2.1 — 71.6%
Hardware requirements: checkpoint around 20GB in NVFP4 and MXFP8 formats; 32GB VRAM or Apple Silicon devices with 32GB+ memory recommended
License: Apache 2.0










Comments