Project Gutenberg books
Over 70k free books in multiple languages for text generation.
- Text generation
- French
- English
- Chinese
- +8
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
Over 70k free books in multiple languages for text generation.
220k math problems with verified reasoning traces from DeepSeek R1.
A massive 2.4 trillion token parallel corpus translated from English into 36 languages.
Largest first-person manual labor video dataset: 100,405 hours and 2 million clips.
860k math problems with step-by-step Chain of Thought solutions for training reasoning models.
114k reasoning examples spanning math, science, code, and puzzles for training LLMs.
A massive archive of minute OHLCV candles for 5,795 Chinese Class A stocks for financial time-series forecasting.
About 1000 hours of narrated English audiobooks with text for ASR training and evaluation.
A mix of expert RL demonstrations, image-caption pairs, and text for training a multimodal agent.
Pre-tokenized version of the giant English FineWeb web corpus in parquet format.
A collection of 50 training vision-language datasets used for fine-tuning Idefics2.
32k tasks from real GitHub issues and PRs across 11 languages for training and evaluating SWE agents.
A three-configuration set featuring CadQuery 3D code, part renders, editing tasks, and CAD QA.
A large multimodal corpus of spatial audio recordings with refined English and Chinese text annotations.
Largest open source code collection from GitHub with full repository context for pre-training code LLMs.
Snapshot of 3.1 million arXiv papers with metadata, files, and PDFs.
Multi-view video recordings of toy vehicle assembly with action and error annotations.
Classic test for predicting the last word in a passage across five European languages.
13,679 crowd-sourced physics, chemistry, and biology exam questions with 4 answer choices and explanations.
Billions of cleaned web documents from Internet Archive and Common Crawl in 191 world languages.
Structured collection of math competition problems and primarily official solutions from AI-MO for training mathematical reasoning.
Tabular and text data with extracted activations of 46 LLMs across 17 semantic concepts.
Generated images, genomes, and VLM agent reasoning logs from the Picbreeder study.
Large corpus of math problems, rewrites, and dialogues for training reasoning language models.