Skip to content

Dataset · CohereLabs

Aya multilingual instructions

CohereLabs/aya_dataset

204K prompt-response pairs across 65 languages for training and evaluating multilingual LLMs.

What's inside

Collected by the Aya Open Science Initiative community via an annotation platform. It contains 204K human-written prompt-completion pairs plus annotator demographics. It covers 65 languages (71 including dialects), with a scale of 100K to 1M examples.

What you can do with it

  • Fine-tune a multilingual LLM on human instructions
  • Evaluate response quality in low-resource languages
  • Create LoRA adapters for multi-language instructions
Tasks
Other
Languages
Amharic, Arabic, Moroccan Arabic, Najdi Arabic, acq, Egyptian Arabic, apc, Bangla and 4 more
Size
100K–1M rows
Downloads this month
26.5K
Likes
382

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("CohereLabs/aya_dataset")