Skip to content

Dataset · TIGER-Lab

MMLU-Pro: challenging knowledge benchmark

TIGER-Lab/MMLU-Pro

12k complex multi-discipline questions for rigorous LLM evaluation.

What's inside

The dataset contains 12k complex questions across various disciplines. It is a more robust and difficult set for multi-task understanding and LLM benchmarking. Modalities are tabular and text, English language; size ranges from 10k to 100k examples.

What you can do with it

  • Evaluating LLMs on MMLU-Pro
  • Comparing models on the leaderboard
  • Testing reasoning after SFT
Tasks
Question answering
Languages
English
Size
10K–100K rows
Downloads this month
397.1K
Likes
607

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("TIGER-Lab/MMLU-Pro")