Skip to content

Dataset · argilla

Mathematical DPO preferences

argilla/distilabel-math-preference-dpo

English math preference dataset in DPO format; card is nearly empty.

What's inside

A text-generation dataset in English with tabular and text modalities, sized at 1k to 10k examples. The card only contains a "More Information needed" placeholder, so composition, source, and format are not described. Judging by the name, it is a preference-DPO set for math answers.

What you can do with it

  • DPO fine-tuning of mathematical LLMs
  • Comparing pairs of math solutions
  • Checking preferences in answers
Tasks
Text generation
Languages
English
Size
1K–10K rows
Downloads this month
294
Likes
88

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("argilla/distilabel-math-preference-dpo")