MiniMax-H3-Prompt-Rewriter-Qwen3.8-27B-FL2VA-heretic GGUF - Quantized Weights for Local Run
2 min read
This repository provides ready-to-use static quantizations (compressed weights) of the MiniMax-H3-Prompt-Rewriter-Qwen3.8-27B-FL2VA-heretic model in GGUF format (a format for running large language models efficiently on consumer hardware). Based on the 27-billion-parameter Qwen architecture, the model is optimized for rewriting and enhancing prompts. It supports multimodal workflows thanks to dedicated mmproj files, making it a great fit for developers and enthusiasts looking to run large language models locally using utilities like llama.cpp.
Key features
- Wide selection of quantizations: ranging from compact Q2_K and Q3_K to high-quality Q6_K and Q8_0, plus the IQ4_XS format.
- Multimodal support: includes mmproj files (Q8_0 and f16 versions) for working with images.
- Speed and quality optimization: recommended fast options like Q4_K_M and Q4_K_S are available.
- GGUF format: full compatibility with popular local clients and inference frameworks.
What you can do
- Run the model locally on your PC or server using llama.cpp or compatible software, matching the quantization to your VRAM and RAM capacity.
- Use the model to automatically improve, detail, and rewrite text prompts.
- Leverage multimodal capabilities by connecting the included mmproj components.
- Set up prompt generation pipelines with different weight compression levels to save resources.
Example
To run GGUF models and work with multimodal components, use tools like llama.cpp by specifying the path to your chosen quantization weight file and the corresponding mmproj file for image processing.
Read more
DetailsBase model: LeViAtHaN2K/MiniMax-H3-Prompt-Rewriter-Qwen3.8-27B-FL2VA-heretic
Available quantizations: Q2_K (11.2 GB), Q4_K_M (16.8 GB), Q6_K (22.2 GB), Q8_0 (28.7 GB), and others
Multimodal additions: mmproj-Q8_0 (0.7 GB) and mmproj-f16 (1.0 GB)
Quantization author: mradermacher














Comments