Inkling 2 Small
open-weights multimodal model
2 min readupdated
Inkling 2 Small is a general-purpose multimodal model that takes text and visual inputs and generates text output. It is built for developers creating AI-powered applications, including agentic systems, chatbots, and coding tools. The model uses a 48-layer decoder with a sparse Mixture-of-Experts (MoE — an architecture where only a subset of parameters is activated per token) and supports a context window of up to 1 million tokens.
Key features
- Supports text and image inputs processed together in a shared latent space.
- 594 billion total parameters, with 17 billion active per token.
- Hybrid attention combining local and global layers.
- Native support for NVFP4 and MXFP8 formats.
What you can do
- Build smart chatbots and agents for complex multi-step tasks using images.
- Integrate the model into IDEs for code analysis and autocompletion.
- Set up retrieval-augmented generation (RAG) systems to work with large documents.
Example
import torch
from transformers import AutoModelForVision2Seq, AutoProcessor
model_id = "crusoeai/Inkling-2-Small-MM"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForVision2Seq.from_pretrained(model_id, torch_dtype=torch.bfloat16, device_map="auto")
Read more
DetailsBenchmarks: AA Index — 30.6, Vals Index — 56.1%, FrontierCode v2.0 — 25.4%
Hardware requirements: at least 500 GB VRAM for NVFP4 (for example, 2x NVIDIA B300 or 4x NVIDIA H200)
Highlights: natively trained in NVFP4, supports integration via vLLM, SGLang, and Unsloth










Comments