WikiText: Wikipedia texts for language modeling
Corpus of verified English Wikipedia articles for training and evaluating language models.
- Text generation
- Fill mask
- English
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
Corpus of verified English Wikipedia articles for training and evaluating language models.
Huge corpus of executable 3D code (Blender, Three.js, CAD) with renders and instructions for 3D generation.
8.5K diverse grade school math problems with step-by-step solutions for reasoning evaluation.
Massive cleaned Common Crawl corpus with en, realnewslike, and multilingual mC4 variants.
Multiple-choice QA benchmark across 57 subjects in English.
7,887 multiple-choice science questions for evaluating question-answering models.
1.3T tokens of filtered educational web pages in English for LLM training.
Large-scale multilingual archive of news articles from 2016–2026 with quality filtering and deduplication.
Large English web corpus broken down by dozens of domains and iteration statistics for training and classification.
12k complex multi-discipline questions for rigorous LLM evaluation.
Massive Chinese text corpus for training and evaluating language models.
A set of complex multi-step tasks from licensed engineers for evaluating AI agents.
Top 10% highest-quality and structured web texts from the FineWeb corpus for language model training.
Over 18.5 trillion tokens of cleaned and deduplicated English web texts from CommonCrawl for LLM training.
Uncleaned archive of correspondence from Ubuntu IRC chats for training text generation language models.
Cleaned Wikipedia articles in multiple languages, with one train split per language.
A Common Crawl document dataset spanning 419 languages, audited and more heavily filtered than alternatives.
Synchronized camera, LiDAR, and step-by-step reasoning data for training autonomous driving systems.
English and German text scripts with sudden emotional shifts for a single character to train expressive TTS models.
Large-scale English corpus of 1.61 million web novel records containing text, tables, and images.
Over 1.1 million hours of web audio in 100+ languages for ASR, TTS, and audio representation learning.
A massive dataset of over 1.1 million hours of audio across 100+ languages for speech tasks.
A subset of 500 math problems from the MATH benchmark for evaluating step-by-step reasoning.
Synthetic short stories with a limited English vocabulary for training and evaluating language models.