Dataset · nvidia
NVIDIA Common Crawl code corpus for pre-training
nvidia/Nemotron-CC-Code-v1
Updated code text dataset with 100 million to 1 billion examples for pre-training language models.
What's inside
The dataset is part of the Nemotron-Pre-Training-Dataset-v2.1 collection and contains 100 million to 1 billion text examples. The data was obtained through a new extraction of programming code from Common Crawl web archives specifically for training the NVIDIA Nemotron 3 model family.
What you can do with it
- Pre-training large language models (LLMs) with strong programming skills
- Fine-tuning existing text models to improve code generation and understanding
- Tasks
- Text generation
- Size
- 100M–1B rows
- Downloads this month
- 31K
- Likes
- 38
- Access
- on request on Hugging Face
Models trained on it
- nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16Text generation 1.1M
- nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4Text generation 641.7K
- nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8Text generation 189.4K
- unsloth/Nemotron-3-Nano-30B-A3B-GGUFText generation 31.7K
- lmstudio-community/NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-4bitText generation 30.5K
- lmstudio-community/NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-8bitText generation 27.6K
- lmstudio-community/NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-6bitText generation 27.2K
- lmstudio-community/NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-5bitText generation 27K
How to load it
from datasets import load_dataset
ds = load_dataset("nvidia/Nemotron-CC-Code-v1")