Dataset · open-r1
350k verified DeepSeek-R1 reasoning traces
open-r1/Mixture-of-Thoughts
350k verified reasoning chains in math, code, and science for training step-by-step reasoning.
What's inside
The dataset contains 350k verified reasoning traces distilled from DeepSeek-R1. Topics include math, programming, and sciences. The data is in English and designed to train language models in step-by-step reasoning. It was used in Open R1 to train the OpenR1-Distill-7B SFT model, replicating the capabilities of DeepSeek-R1-Distill-Qwen-7B on the same base model.
What you can do with it
- SFT fine-tuning of a 7B model for step-by-step reasoning
- Testing model capabilities in solving math and coding tasks
- Replicating DeepSeek-R1 distillation in Open R1
- Tasks
- Text generation
- Languages
- English
- Size
- 100K–1M rows
- Downloads this month
- 27.9K
- Likes
- 351
Models trained on it
- mradermacher/Bala-30B-A3B-i1-GGUF 3.9K
- mradermacher/Lucie-7B-GRPO-Science-500-i1-GGUF 2.1K
- mradermacher/MamayLM-Gemma-3-12B-IT-v1.0-i1-GGUF 1.5K
- INSAIT-Institute/MamayLM-Gemma-3-4B-IT-v1.0Image text → text 1.2K
- tudor-iustin22/Bluebird-1.5-InstructText generation 1.2K
- mradermacher/Mixtral-8x7B-DeepSeek-R1-Distill-i1-GGUF 1.2K
- mradermacher/Grifflet-2-i1-GGUF 875
- INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0Image text → text 769
How to load it
from datasets import load_dataset
ds = load_dataset("open-r1/Mixture-of-Thoughts")