Skip to content

Dataset · meituan-longcat

Olympiad math benchmark for LLMs

meituan-longcat/AMO-Bench

A collection of difficult high school math competition problems in English to test language model reasoning.

What's inside

Inside are text-based high school olympiad math problems in English, totaling under 1k examples. The problems are newly created by experts to prevent data leaks from open sources, and are provided with detailed step-by-step solutions and final answers.

What you can do with it

  • Evaluating mathematical reasoning of reasoning LLMs
  • Comparing token consumption efficiency when solving complex problems
Tasks
Question answering
Languages
English
Size
up to 1K rows
Downloads this month
3.4K
Likes
37

How to load it

from datasets import load_dataset

ds = load_dataset("meituan-longcat/AMO-Bench")