Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetSalesforce/wikitext

WikiText: Wikipedia texts for language modeling

Corpus of verified English Wikipedia articles for training and evaluating language models.

  • Text generation
  • Fill mask
  • English
2.5M 8701M–10M rows
DatasetDAGroup-PKU/Open-HumanWAM-50KTop pick

50K hours of first-person hand action videos

Large multimodal corpus of human hand manipulation videos with motion annotations and descriptions for robot learning.

  • Robotics
1.5M 3610M–100M rows🔒 on request
Datasetopenai/gsm8k

Grade school math word problems

8.5K diverse grade school math problems with step-by-step solutions for reasoning evaluation.

  • Text generation
  • English
1.3M 2.1K10K–100K rows
Datasetryanmarten/OpenThoughts-1k-sample

OpenThoughts reasoning sample

1K examples of synthetic reasoning across math, science, code, and puzzles.

    1.2M 761K–10K rows
    Datasetallenai/c4

    C4 cleaned web corpus

    Massive cleaned Common Crawl corpus with en, realnewslike, and multilingual mC4 variants.

    • Text generation
    • Fill mask
    • Afrikaans
    • Amharic
    • Arabic
    • +9
    775.4K 70510B–100B rows
    Datasetcais/mmlu

    MMLU: Massive multitask benchmark

    Multiple-choice QA benchmark across 57 subjects in English.

    • Question answering
    • English
    612.7K 898100K–1M rows
    Datasetieasybooks-org/prophet-mosque-libraryTop pick

    Prophet's Mosque Library: 48k Arabic Books

    Digitized Arabic Islamic books from the Prophet's Mosque Library for OCR and language models.

    • Image → text
    • Arabic
    545.7K 2710K–100K rows
    Datasetallenai/ai2_arc

    AI2 ARC: Science Questions

    7,887 multiple-choice science questions for evaluating question-answering models.

    • Question answering
    • English
    545.4K 4331K–10K rows
    Datasetnyu-mll/glue

    GLUE benchmark for language understanding

    Collection of tasks and data for training and evaluating English text understanding systems.

    • Text classification
    • English
    467.2K 7871M–10M rows
    DatasetHuggingFaceFW/fineweb-eduTop pick

    FineWeb-Edu educational web texts

    1.3T tokens of filtered educational web pages in English for LLM training.

    • Text generation
    • English
    459.9K 1.5K1B–10B rows
    Datasetksolovev/fine-newsTop pick

    Cleaned corpus of 635M news articles in six languages

    Large-scale multilingual archive of news articles from 2016–2026 with quality filtering and deduplication.

    • Text generation
    • Text classification
    • Text retrieval
    • English
    • Spanish
    • Russian
    • +9
    459.8K 53100M–1B rows
    Datasetm-a-p/FineFineWebTop pick

    FineFineWeb: domain-specific web corpus

    Large English web corpus broken down by dozens of domains and iteration statistics for training and classification.

    • Text classification
    • Text generation
    • English
    435.2K 2441B–10B rows
    Datasetlioooox/T2I-CoReBench-Images

    Images for T2I logic and composition evaluation

    Generated images from complex prompts to check composition and logical relations in text-to-image models.

    • Text → image
    • English
    408.5K 610K–100K rows
    Datasetepfml/FineWeb-HQ

    Curated FineWeb texts for LLM pretraining

    Top 10% highest-quality and structured web texts from the FineWeb corpus for language model training.

    • Text generation
    • English
    368.1K 361B–10B rows
    DatasetHuggingFaceFW/finewebTop pick

    Cleaned English web corpus

    Over 18.5 trillion tokens of cleaned and deduplicated English web texts from CommonCrawl for LLM training.

    • Text generation
    • English
    361.5K 3.8K10B–100B rows
    DatasetTuxifan/UbuntuIRC

    Ubuntu IRC channel logs

    Uncleaned archive of correspondence from Ubuntu IRC chats for training text generation language models.

    • Text generation
    351.2K 41M–10M rows
    Datasetshash42/forecast-news

    10-year daily news archive

    Cleaned corpus of 31.8 million news articles for 2016-2026 for forecasting systems.

      343.7K 910M–100M rows
      Datasetwikimedia/wikipedia

      Wikipedia in all languages

      Cleaned Wikipedia articles in multiple languages, with one train split per language.

      • Text generation
      • Fill mask
      • Abkhazian
      • Acehnese
      • Adyghe
      • +9
      333.5K 1.8K10M–100M rows
      Datasetopenai/gdpvalTop pick

      GDPval Benchmark for Real-World Work Tasks

      220 expert tasks across 44 professions with prompts and files for evaluating AI on economically significant work.

        294.3K 579up to 1K rows