Dataset · nvidia
Data for training reward models
nvidia/HelpSteer2
English helpfulness dataset for aligning LLMs on factuality, coherence, and response length.
What's inside
Open Helpfulness Dataset under the CC-BY-4.0 license; contains text and tabular data for model alignment. Enables fine-tuning for response helpfulness, factual accuracy, and coherence, as well as complexity and verbosity. Created in collaboration with Scale AI; volume is 10k-100k examples, language is English.
What you can do with it
- Train a reward model for RLHF
- Fine-tune Llama 3.1 70B Instruct
- Evaluate on RewardBench
- Languages
- English
- Size
- 10K–100K rows
- Downloads this month
- 20K
- Likes
- 468
Models trained on it
- StrandsAgents/strands-decider-2B-qwen3.5-v1-2610Text classification 24.5K
- StrandsAgents/strands-decider-2B-hobson-v21Text classification 15.6K
- nvidia/Llama-3.1-Nemotron-70B-Instruct-HFText generation 13.3K
- LxzGordon/URM-LLaMa-3.1-8BText classification 7.4K
- StrandsAgents/strands-decider-2B-hobson-v19Text classification 7K
- bartowski/frontier-infra_jebadiah-9b-v2-GGUFImage text → text 5.1K
- jaredpalmer/kev-27bText classification 3.4K
- bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUFText generation 2.6K
How to load it
from datasets import load_dataset
ds = load_dataset("nvidia/HelpSteer2")