Dataset · AYueksel
Turkish high school curriculum benchmark
AYueksel/TurkishMMLU
Multiple-choice test suite across nine Turkish school subjects to evaluate language model knowledge and logic.
What's inside
Includes between 1,000 and 10,000 Turkish multiple-choice text questions based on the Turkish high school curriculum across nine disciplines. Presented at the ACL 24 SIGTURK workshop, it assesses mathematical skills, logic, and text comprehension. The open repository provides code and data analysis, while the materials themselves are available upon email request.
What you can do with it
- Evaluating Turkish language comprehension and reasoning in LLMs
- Comparing models on a specialized educational benchmark
- Analyzing weaknesses of multilingual models in school subjects
- Tasks
- Question answering
- Languages
- Turkish
- Size
- 1K–10K rows
- Downloads this month
- 1.8K
- Likes
- 19
How to load it
from datasets import load_dataset
ds = load_dataset("AYueksel/TurkishMMLU")