Skip to content

Dataset · AYueksel

Turkish high school curriculum benchmark

AYueksel/TurkishMMLU

Multiple-choice test suite across nine Turkish school subjects to evaluate language model knowledge and logic.

What's inside

Includes between 1,000 and 10,000 Turkish multiple-choice text questions based on the Turkish high school curriculum across nine disciplines. Presented at the ACL 24 SIGTURK workshop, it assesses mathematical skills, logic, and text comprehension. The open repository provides code and data analysis, while the materials themselves are available upon email request.

What you can do with it

  • Evaluating Turkish language comprehension and reasoning in LLMs
  • Comparing models on a specialized educational benchmark
  • Analyzing weaknesses of multilingual models in school subjects
Tasks
Question answering
Languages
Turkish
Size
1K–10K rows
Downloads this month
1.8K
Likes
19

How to load it

from datasets import load_dataset

ds = load_dataset("AYueksel/TurkishMMLU")