Skip to content

Dataset · Maxwell-Jia

AIME 2024 problems for evaluating math models

Maxwell-Jia/AIME_2024

30 English AIME 2024 problems in JSONL for evaluating mathematical reasoning.

What's inside

The dataset contains 30 problems from AIME 2024 (I and II), a prestigious high school mathematics competition. The records are in English in JSONL format, and the card specifies the problem ID among its fields. The data is suitable for evaluating models on complex math problems.

What you can do with it

  • Evaluate LLMs on AIME 2024 problems
  • Test reasoning models on complex math
  • Compare models on a small math benchmark
Tasks
Text generation
Languages
English
Size
up to 1K rows
Downloads this month
73.8K
Likes
96

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("Maxwell-Jia/AIME_2024")