Dataset · meituan-longcat
Olympiad math benchmark for LLMs
meituan-longcat/AMO-Bench
A collection of difficult high school math competition problems in English to test language model reasoning.
What's inside
Inside are text-based high school olympiad math problems in English, totaling under 1k examples. The problems are newly created by experts to prevent data leaks from open sources, and are provided with detailed step-by-step solutions and final answers.
What you can do with it
- Evaluating mathematical reasoning of reasoning LLMs
- Comparing token consumption efficiency when solving complex problems
- Tasks
- Question answering
- Languages
- English
- Size
- up to 1K rows
- Downloads this month
- 3.4K
- Likes
- 37
How to load it
from datasets import load_dataset
ds = load_dataset("meituan-longcat/AMO-Bench")