Dataset · eaddario
Imatrix calibration dataset for LLaMA.cpp
eaddario/imatrix-calibration
Small text dataset for calculating the importance matrix during model quantization.
What's inside
This is calibration data for generating the importance matrix (imatrix), which is needed to reduce errors when quantizing models in LLaMA.cpp. The llama-imatrix program does not read parquet directly, so it is suggested to convert the files to a text format, for example via DuckDB. The card specifies the languages ar, de, en, es, fr, hi and a size of less than 1k examples.
What you can do with it
- Imatrix calibration before LLM quantization in LLaMA.cpp
- Preparing a text file for llama-imatrix
- Testing the quality of quantized models on multilingual texts
- Tasks
- Text generation
- Languages
- Arabic, German, English, Spanish, French, Hindi, Indonesian, Italian and 4 more
- Size
- up to 1K rows
- Downloads this month
- 9K
- Likes
- 79
Models trained on it
- eaddario/Watt-Tool-8B-GGUFText generation 2.7K
- eaddario/Dolphin3.0-R1-Mistral-24B-GGUFText generation 2.4K
- eaddario/Nanbeige4.3-33B-JQKText generation 2.4K
- eaddario/DeepSeek-R1-Distill-Qwen-7B-GGUFText generation 2.3K
- eaddario/Qwen3-30B-A3B-GGUFText generation 1.8K
- eaddario/Qwen3-8B-GGUFText generation 1.7K
- eaddario/Dolphin3.0-Mistral-24B-GGUFText generation 1.7K
- AlexanderKyng/Qwen3.8-27B-48GbImage text → text 1.6K
How to load it
from datasets import load_dataset
ds = load_dataset("eaddario/imatrix-calibration")