Skip to content

Dataset · facebook

Belebele Multilingual Benchmark

facebook/belebele

MRC benchmark with questions and 4-way multiple-choice options across 122 language varieties, including low-resource ones.

What's inside

Belebele is a multiple-choice reading comprehension benchmark. Questions are tied to short passages from FLORES-200 and feature four answer choices. The dataset covers 122 language varieties, ranging from high- to low-resource languages; questions are human-annotated.

What you can do with it

  • Zero-shot evaluation of multilingual LLMs
  • Comparison of mono- and multilingual models
  • NLU testing on low-resource languages
Tasks
Question answering, Zero shot classification, Text classification, Multiple choice
Languages
Afrikaans, Amharic, Arabic, Azerbaijani, Assamese, Bambara, Bangla, Tibetan and 4 more
Size
100K–1M rows
Downloads this month
53.5K
Likes
146

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("facebook/belebele")