Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetAgentPublic/open_governmentTop pick

Open government data corpus with 380 billion tokens

Massive text and table corpus from open government archives of the USA, France, and EU for language model pre-training.

  • Text generation
  • English
  • French
  • Bulgarian
  • +9
3.6K 710M–100M rows
DatasetPleIAs/French-PD-Newspapers

French public domain newspapers

Corpus of French public domain newspapers and periodicals for language models.

  • Text generation
  • French
3.5K 741M–10M rows
Datasettrace-commons/agent-traces

AI coding agent session logs

Open collection of real developer dialogs with AI agents, including tool calls and command outputs.

  • Text generation
  • English
3.3K 41up to 1K rows
Datasetopen-index/open-github

GitHub public events and activity archive

Tabular and text data on pushes, pull requests, releases, and discussions from public repositories.

  • Text generation
  • Text classification
  • Embeddings
  • English
  • Multiple languages
3.1K 12100K–1M rows
Dataseta-m-team/AM-DeepSeek-Distilled-40MTop pick

Large distilled reasoning corpus for LLMs

A large-scale text dataset with difficulty grading for SFT and enhancing model reasoning skills.

  • Text generation
  • Chinese
  • English
3K 5610M–100M rows
DatasetHuggingFaceBio/carbon-pretraining-corpusTop pick

1.1 trillion nucleotide DNA and RNA genomic corpus

173 million eukaryotic and prokaryotic DNA and RNA sequences for pretraining base genomic models.

  • Text generation
2.9K 34100M–1B rows
DatasetCohereLabs/aya_evaluation_suite

Multilingual dialogue prompt benchmark by Cohere

26,750 open prompts in over 100 languages for evaluating text generation quality.

  • Text generation
  • Afrikaans
  • Albanian
  • Amharic
  • +9
2.8K 5510K–100K rows
Datasetbigcode/the-stack-v2-dedup

Deduplicated code corpus The Stack v2

Nearly deduplicated version of The Stack v2—a large code corpus for LLM training, grouped by repositories.

  • Text generation
  • Code
2.8K 1481B–10B rows🔒 on request
DatasetHPAI-BSC/medical-specialities

Medical question classification

Dataset for evaluating medical language models across 35 categories.

  • Question answering
  • English
2.7K 810K–100K rows
DatasetCongliu/Chinese-DeepSeek-R1-Distill-data-110k

Chinese DeepSeek R1 distillate at 110k examples

110k Chinese examples with answers and R1 reasoning traces for SFT.

  • Text generation
  • Question answering
  • Chinese
2.6K 804100K–1M rows
Datasetammarnasr/the-stack-rust-clean

Cleaned Rust source code from TheStack corpus

One million Rust source code files from GitHub for training and fine-tuning compact language models.

  • Text generation
  • Code
2.4K 26100K–1M rows
Datasetbiglam/europeana_newspapers

Historical European newspapers

European newspaper texts from the 18th to early 20th century for training and research.

  • Text generation
  • German
  • French
  • Greek
  • +9
2.4K 6910M–100M rows
Datasetdata-is-better-together/10k_prompts_ranked

10k prompts with quality ratings

10,331 community-rated prompts for training and evaluating prompt ranking.

  • Text classification
  • Text generation
  • Reinforcement learning
  • English
2.4K 17910K–100K rows
DatasetManusagents/Omni-Frontier-Distillation-SFT-Cyber-security-Coding-dataset-collection-v2Top pick

Large-scale SFT corpus for code, cybersecurity, and science

Deduplicated SFT dataset of 10M to 100M rows for training reasoning, programming, math, and cybersecurity.

  • Text generation
  • Question answering
  • English
2.3K 910M–100M rows
DatasetLEXam-Benchmark/LEXamTop pick

LEXam legal reasoning benchmark

340 legal exams from Switzerland, the EU, and international law for evaluating reasoning models.

  • Text classification
  • Text generation
  • English
  • German
2.1K 811K–10K rows
Datasetgeneralmachines/CartTrace-100kTop pick

CartTrace-100k agent shopping behavior dataset

Over 100,000 records of AI agent shopping sessions for text-generation and RL tasks.

  • Text generation
  • Reinforcement learning
  • English
  • Filipino
2.1K 91M–10M rows
Datasetopen-index/open-library

Complete Open Library book catalog in parquet

Over 150 million bibliographic records from the Open Library project for NLP, search, and data extraction tasks.

  • Text generation
  • Embeddings
  • Text classification
  • English
  • Multiple languages
2.1K 11100M–1B rows
Datasetgsarti/flores_101

101-language machine translation benchmark

Professionally translated Wikipedia sentences in 101 languages for evaluating multilingual translation quality.

  • Text generation
  • Translation
  • Afrikaans
  • Amharic
  • Arabic
  • +9
2K 35100K–1M rows
DatasetDigitaluz/uzbek-language-corpusTop pick

Cleaned Uzbek language corpus

Large cleaned Uzbek language corpus in Latin and Cyrillic scripts for model pre-training.

  • Text generation
  • Fill mask
  • Uzbek
2K 1011M–10M rows