FineWeb-Edu educational web texts
1.3T tokens of filtered educational web pages in English for LLM training.
- Text generation
- English
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
1.3T tokens of filtered educational web pages in English for LLM training.
Large-scale multilingual archive of news articles from 2016–2026 with quality filtering and deduplication.
Large English web corpus broken down by dozens of domains and iteration statistics for training and classification.
12k complex multi-discipline questions for rigorous LLM evaluation.
Top 10% highest-quality and structured web texts from the FineWeb corpus for language model training.
Over 18.5 trillion tokens of cleaned and deduplicated English web texts from CommonCrawl for LLM training.
English and German text scripts with sudden emotional shifts for a single character to train expressive TTS models.
Large-scale English corpus of 1.61 million web novel records containing text, tables, and images.
Over 1.1 million hours of web audio in 100+ languages for ASR, TTS, and audio representation learning.
A massive dataset of over 1.1 million hours of audio across 100+ languages for speech tasks.
FineWeb-2 pretraining corpus with 1000+ languages for training language models.
Challenging NLU tasks including textual entailment, QA, and coreference resolution for language model evaluation.
English synthetic text data generated by SmolLM2 from the FineWeb-Edu corpus.
English QA benchmark with questions requiring multi-step reasoning and general knowledge.
Pre-tokenized version of the giant English FineWeb web corpus in parquet format.
A three-configuration set featuring CadQuery 3D code, part renders, editing tasks, and CAD QA.
Largest open source code collection from GitHub with full repository context for pre-training code LLMs.
Billions of cleaned web documents from Internet Archive and Common Crawl in 191 world languages.
Snapshot of 3.1 million arXiv papers with metadata, files, and PDFs.
A large source code corpus in dozens of programming languages with permissive licenses.
Expert-level multiple-choice questions in biology, physics, and chemistry to test complex scientific reasoning.
5.5K data analysis tasks: table, question, and ground truth answer.
The largest open text corpus from PDFs: 3 trillion tokens, 475 million documents, and 1,733 languages.
Tabular and text dataset of human gene expression profiles during respiratory viral immunization.