Dataset · MBZUAI
3.4M instructions and responses across 52 languages
MBZUAI/Bactrian-X
3.4 million instruction-response pairs across 52 languages, translated from English alpaca-52k and dolly-15k.
What's inside
The dataset contains 3.4 million instruction-response pairs across 52 languages. 67k English instructions from alpaca-52k and dolly-15k were translated into 51 languages via the Google Translate API. Languages include Afrikaans, Arabic, Azerbaijani, Bengali, Czech, German, and others; the format is not specified in the card.
What you can do with it
- SFT of a multilingual instruction model
- LoRA fine-tuning for low-resource languages
- Evaluating cross-lingual instruction-following
- Tasks
- Text generation
- Languages
- Afrikaans, Arabic, Azerbaijani, Bangla, Czech, German, English, Spanish and 4 more
- Size
- 1M–10M rows
- Downloads this month
- 2K
- Likes
- 126
Models trained on it
- mradermacher/DukunLM-13B-V1.0-Uncensored-sharded-i1-GGUF 2.6K
- mradermacher/DukunLM-7B-V1.0-Uncensored-i1-GGUF 1.2K
- mradermacher/DukunLM-13B-V1.0-Uncensored-i1-GGUF 621
- mradermacher/DukunLM-7B-V1.0-Uncensored-sharded-i1-GGUF 612
- mradermacher/DukunLM-13B-V1.0-Uncensored-sharded-GGUF 456
- mradermacher/OpenMia-Indo-Mistral-7b-v3-refined-i1-GGUF 332
- mradermacher/DukunLM-7B-V1.0-Uncensored-sharded-GGUF 328
- aerner/lm-v1Text generation 318
How to load it
from datasets import load_dataset
ds = load_dataset("MBZUAI/Bactrian-X")