MiniMax-H3-ClipProj-GGUF
projection weights for text encoders
2 min readupdated
This repository provides a set of GGUF projection weights (weights quantization and storage format) that enable using more compact Qwen3-VL text encoders (such as the 4B and 8B versions) instead of the standard heavy Qwen3-VL-32B encoder in the MiniMax-H3 model family. Since MiniMax-H3 video, MiniMax-H3-Image, and P-H3-Image models share a 5,120-dimensional text conditioning, a single projection matrix works for all three variants. The generation models themselves, base encoders, and VAE are not included. This tool will be useful for developers and enthusiasts looking to optimize running MiniMax-H3 generative models on available hardware.
Key features
- Compatibility with MiniMax-H3 video, MiniMax-H3-Image, and P-H3-Image models thanks to a unified text conditioning format.
- Support for encoders of various sizes: from current versions of Qwen3-VL-4B and Qwen3-VL-8B to legacy Qwen3-VL-2B variants.
- Availability of two architectural options for matrices: standard projections (such as Ridge) and larger MLP versions.
- Precise preservation of source weights tensor accuracy without additional quantization.
What you can do
- Run video or image generation with MiniMax-H3 models using a reduced text encoder to save resources.
- Build the Romara Labs stable-diffusion.cpp fork with support for custom weights connection patches.
- Configure command line parameters with --llm and --cliproj flags to integrate matrices into the generation process.
Example
Example of using weights and a text encoder in the command line when starting generation:
--llm /path/to/qwen3-vl-4b.gguf \
--cliproj /path/to/mmh3-4b-ClipProj-v3.1.ggufRead more
DetailsProjection weights are calibrated on video prompts.
Text input also works for image generation, but quality in this mode has not been systematically tested.
Licensing is subject to the MiniMax H3 Community License Agreement terms.














Comments