Skip to content

Dataset · argilla

7k-example Capybara DPO dataset

argilla/distilabel-capybara-dpo-7k-binarized

Binarized preferences for DPO based on Capybara: multi-turn dialogues for training chat models.

What's inside

A preference dataset for DPO collected via distilabel based on LDJnr/Capybara. This is a 7k-example preview version; v2 promises the full base dataset and responses from stronger models. Language is en, table and text format, size 1K-10K.

What you can do with it

  • Train a chat model via DPO
  • Conduct RLHF preferences
  • Evaluate multi-turn responses
Tasks
Question answering, Text generation
Languages
English
Size
1K–10K rows
Downloads this month
7.5K
Likes
193

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("argilla/distilabel-capybara-dpo-7k-binarized")