Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetliwu/MNBVC

Massive Chinese MNBVC text corpus

Massive Chinese text corpus for training and evaluating language models.

  • Text generation
  • Fill mask
  • Chinese
383.7K 680
Datasetgoogle/physical-engineerings-last-examTop pick

Google engineering task benchmark

A set of complex multi-step tasks from licensed engineers for evaluating AI agents.

  • Text generation
  • Question answering
  • English
378.3K 191up to 1K rows🔒 on request
Datasetaxisrobotics/Franka-Datasets-v2

Franka robot manipulation simulation demos

Simulation demonstrations for training language-conditioned Franka robot manipulation policies.

  • English
373.8K 2
Datasetepfml/FineWeb-HQ

Curated FineWeb texts for LLM pretraining

Top 10% highest-quality and structured web texts from the FineWeb corpus for language model training.

  • Text generation
  • English
368.1K 361B–10B rows
Datasetharborframework/terminal-bench-science-lfs

Large input files for Terminal-Bench-Science

Mirror of heavy files for scientific tasks of the Terminal-Bench-Science benchmark excluded from git.

    365.1K 11
    DatasetHuggingFaceFW/finewebTop pick

    Cleaned English web corpus

    Over 18.5 trillion tokens of cleaned and deduplicated English web texts from CommonCrawl for LLM training.

    • Text generation
    • English
    361.5K 3.8K10B–100B rows
    DatasetTuxifan/UbuntuIRC

    Ubuntu IRC channel logs

    Uncleaned archive of correspondence from Ubuntu IRC chats for training text generation language models.

    • Text generation
    351.2K 41M–10M rows
    Datasetshash42/forecast-news

    10-year daily news archive

    Cleaned corpus of 31.8 million news articles for 2016-2026 for forecasting systems.

      343.7K 910M–100M rows
      Datasetwikimedia/wikipedia

      Wikipedia in all languages

      Cleaned Wikipedia articles in multiple languages, with one train split per language.

      • Text generation
      • Fill mask
      • Abkhazian
      • Acehnese
      • Adyghe
      • +9
      333.5K 1.8K10M–100M rows
      Datasetallenai/MADLAD-400Top pick

      Multilingual document corpus across 419 languages

      A Common Crawl document dataset spanning 419 languages, audited and more heavily filtered than alternatives.

      • Text generation
      327.1K 185over 1T rows
      Datasetnureasoning/nuReasoningTop pick

      Multimodal Reasoning Dataset for Autonomous Vehicles

      Synchronized camera, LiDAR, and step-by-step reasoning data for training autonomous driving systems.

      • Visual question answering
      • Text generation
      • Robotics
      311.7K 2910K–100K rows🔒 on request
      Datasetopenai/gdpvalTop pick

      GDPval Benchmark for Real-World Work Tasks

      220 expert tasks across 44 professions with prompts and files for evaluating AI on economically significant work.

        294.3K 579up to 1K rows
        Datasetopenai/openai_humaneval

        HumanEval: 164 Programming Tasks

        A benchmark of 164 Python tasks with signatures, docstrings, and unit tests for code generation evaluation.

        • English
        293.5K 420up to 1K rows
        DatasetHuggingFaceM4/FineVisionMaxTop pick

        Giant Collection of Images and Dialogues for VLMs

        24.3 million interleaved image-text examples in English and Chinese for training multimodal models.

        • Image text → text
        • English
        • Chinese
        291.9K 4810M–100M rows
        Datasetgoogle-research-datasets/mbpp

        MBPP Python Tasks Benchmark

        About 1,000 Python tasks with descriptions, solutions, and tests for code generation evaluation.

        • English
        288.7K 2791K–10K rows