Dataset · HuggingFaceTB
SmolLM3-3B post-training data
HuggingFaceTB/smoltalk2
1M to 10M text examples across three subsets for intermediate training, SFT, and preference alignment of SmolLM3.
What's inside
The dataset contains three subsets: Mid, SFT, and Preference. These correspond to the three post-training phases of the SmolLM3-3B model. The card includes links to a blog post and a training recipe with subset weights. Loaded via datasets; language is not specified in metadata, modality is text.
What you can do with it
- SFT for SmolLM3-3B or a similar small LLM
- DPO/preference training
- Reproducing the SmolLM3 post-training recipe
- Size
- 1M–10M rows
- Downloads this month
- 61.2K
- Likes
- 188
Models trained on it
- mradermacher/Qwen3.5-4B-DeepThought-STEM-i1-GGUF 4.7K
- mradermacher/Qwen3.5-9B-DeepThought-STEM-i1-GGUF 3.6K
- mradermacher/Mercury-Acad-1.7B-i1-GGUF 3K
- mradermacher/Qwen3.5-9B-DeepThought-STEM-GGUF 2.9K
- xtools-at/Qwen3.5-9B-DeepThought-STEMText generation 2.3K
- mradermacher/Qwen3.5-4B-DeepThought-STEM-GGUF 2.2K
- xtools-at/Qwen3.5-4B-DeepThought-STEMText generation 1.9K
- nkthebass/tinybrainbot-100m-v5.1-instructText generation 1.7K
How to load it
from datasets import load_dataset
ds = load_dataset("HuggingFaceTB/smoltalk2")