Skip to content

Dataset · project-numina

90 AIME problems for math model validation

project-numina/aimo-validation-aime

All 90 AIME 2022–2024 problems from the AOPS wiki as an internal validation set for math models.

What's inside

This dataset contains 90 problems from the 2022, 2023, and 2024 AIME competitions, extracted from the AOPS wiki. It serves as the internal validation set used in the AIMO Progress Prize, with post-2021 problems chosen to prevent overlap with the MATH training set. The dataset card mentions columns including problem.

What you can do with it

  • Testing LLM mathematical reasoning on AIME problems
  • Comparing models on a small, fixed benchmark
  • Evaluating reasoning model robustness on challenging problems
Size
up to 1K rows
Downloads this month
44K
Likes
69

How to load it

from datasets import load_dataset

ds = load_dataset("project-numina/aimo-validation-aime")