Dataset · HuggingFaceCode
The Stack v3: GitHub code for LLM training
HuggingFaceCode/stack-v3-train
Largest open source code collection from GitHub with full repository context for pre-training code LLMs.
What's inside
Source code collected directly from GitHub for pre-training code LLMs with full repository context. Positioned as the largest and freshest open code dataset, a successor to The Stack v2. Modalities are text and tabular data, language is code, and size is between 100M and 1B.
What you can do with it
- Pre-training code LLMs
- Fine-tuning programming assistants
- Testing models on repository-context tasks
- Tasks
- Text generation
- Languages
- Code
- Size
- 100M–1B rows
- Downloads this month
- 123.2K
- Likes
- 404
Models trained on it
- DedeProGames/Kiyo-65MText generation 913
- BosonicJustin/transcendent-logic-modelText generation 585
- mradermacher/transcendent-logic-model-GGUF 544
- DedeProGames/Kiyo-230M-PreviewText generation 526
- DedeProGames/GPT-U-20MText generation 324
- mradermacher/Kiyo-135M-GGUF 254
- mradermacher/Kiyo-65M-GGUF 253
- DedeProGames/Wisp-15MText generation 219
How to load it
from datasets import load_dataset
ds = load_dataset("HuggingFaceCode/stack-v3-train")