Dataset · Maxwell-Jia
AIME 2024 problems for evaluating math models
Maxwell-Jia/AIME_2024
30 English AIME 2024 problems in JSONL for evaluating mathematical reasoning.
What's inside
The dataset contains 30 problems from AIME 2024 (I and II), a prestigious high school mathematics competition. The records are in English in JSONL format, and the card specifies the problem ID among its fields. The data is suitable for evaluating models on complex math problems.
What you can do with it
- Evaluate LLMs on AIME 2024 problems
- Test reasoning models on complex math
- Compare models on a small math benchmark
- Tasks
- Text generation
- Languages
- English
- Size
- up to 1K rows
- Downloads this month
- 73.8K
- Likes
- 96
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("Maxwell-Jia/AIME_2024")