Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetIFM/TxT360-v2

TxT360-v2: web and QA texts

Corpus of web and question-answering texts for model pre-training from the K2 Horizon release.

  • Text generation
76.8K 1091B–10B rows
Datasetdeepmind/code_contests

Competitive programming tasks

A collection of competitive programming problems from various platforms for training and evaluating models.

  • Translation
  • English
62.4K 2471K–10K rows
DatasetKodCode/KodCode-V1-SFT-R1

Synthetic coding tasks with tests

Large corpus of English synthetic coding tasks with verifiable solutions and tests for SFT and RL.

  • Question answering
  • English
61.1K 40100K–1M rows
DatasetOpenSQZ/AutoMathText-V2Top pick

2.46T STEM Tokens for Pre-training

A massive cleaned corpus on STEM, mathematics, code, and reasoning in English and Chinese.

  • Text generation
  • Question answering
  • English
  • Chinese
60.9K 781B–10B rows
Datasetdavidheineman/tiny-rl-refined-tasks-v5

Dataset for SFT and RL training

Text tasks for SFT and RL with prediction tokens and model rewards.

  • Text generation
  • English
53.2K 01M–10M rows
Datasetise-uiuc/Magicoder-OSS-Instruct-75K

OSS-Instruct Code Generation Instructions

A set of OSS-Instruct instructions generated by gpt-3.5-turbo-1106 for code generation tasks.

  • Text generation
51.4K 18610K–100K rows
Datasetepfml/FineWeb2-HQ

FineWeb2-HQ: High-quality corpus for pretraining

A quality-filtered subset of FineWeb2 across 20 languages for faster language model pretraining.

  • Text generation
  • Russian
  • Chinese
  • German
  • +9
49.3K 89100M–1B rows
DatasetPresentBench/PresentBench

Presentation generation evaluation benchmark

English and Chinese documents and tables for testing slide generation.

  • Multimodal
  • Text generation
  • English
  • Chinese
47K 16up to 1K rows
DatasetJonesLin/writing-model-papers-2016-2021

Corpus of scientific papers 2016-2021

Collection of open scientific texts and metadata from arXiv, CVF, NeurIPS, and other venues.

  • Text generation
  • English
45.5K 010K–100K rows
Datasetyhcelebi/enterprise-dataTop pick

Synthetic Accounting and Operations of 30 Companies

A massive 9.3-billion-row tabular corpus with complete financial statements of fictional firms over 31 years.

  • Tabular classification
  • Tabular regression
  • Time series forecasting
  • English
  • Turkish
45.2K 21B–10B rows
Datasetlaion/Scientific-SummariesTop pick

22 million structured scientific article summaries

A massive corpus of scientific paper summaries with OpenAlex metadata and full texts of 5.3 million articles.

  • Summarization
  • Text classification
  • Embeddings
  • English
  • Multilingual
45.2K 3510M–100M rows
Datasethausmer/ua-ru-tg-channels-cleanTop pick

Cleaned Telegram channel posts in Russian and Ukrainian

Over 1.3M PII-free posts from 110 news, IT, and official Telegram channels for language model training.

  • Text generation
  • Ukrainian
  • Russian
43K 01M–10M rows🔒 on request
Datasetnguha/legalbench

LegalBench legal reasoning benchmark

162 English tasks for evaluating LLM legal reasoning across classification and question answering.

  • Text classification
  • Question answering
  • English
41.4K 20010K–100K rows
Datasetopenbmb/UltraData-Code

GitHub Code with L0–L3 Cleaning Levels

GitHub code with L0–L3 cleaning levels for training language models.

  • Text generation
  • English
  • Chinese
39.4K 216100M–1B rows
Datasetmath-ai/AutoMathText-2.5Top pick

AutoMathText-2.5 math and STEM corpus with 2T tokens

Cleaned bilingual (EN/ZH) corpus exceeding 2 trillion tokens on mathematics, code, and reasoning for LLM training.

  • Text generation
  • Question answering
  • English
  • Chinese
39.4K 31B–10B rows
Datasetlianghsun/tw-legal-oa-corpus

Taiwan legal corpus in Traditional Chinese

Over 33 thousand open legal articles and publications in Traditional Chinese for fine-tuning language models.

  • Text generation
  • Chinese
35.8K 010K–100K rows🔒 on request
DatasetHuggingFaceH4/ultrafeedback_binarized

Preference pairs for chat models

Processed UltraFeedback: 64k prompts with model answers and GPT-4 scores aggregated into preference pairs.

  • Text generation
  • English
35K 363100K–1M rows
Datasetlukakuma/web-trajectories-preference-raw

Raw web agent trajectories with images

Large raw archive of successful and failed web agent actions in English and Korean for subsequent filtering.

  • Text generation
  • English
  • Korean
34.4K 01M–10M rows🔒 on request
Datasetlongvideobench/LongVideoBench

Long-video understanding benchmark up to 1 hour for LMMs

3,763 long captioned videos with questions to evaluate long-context multimodal models.

  • Multiple choice
  • Visual question answering
  • English
33.6K 641K–10K rows🔒 on request
DatasetBiogod/PMC-ClinicalLogsTop pick

Clinical logs and images from 150k PubMed articles

Chronological clinical events and 480 thousand medical images from 150 thousand PubMed Central cases.

  • Text generation
  • Question answering
  • English
32.3K 0100K–1M rows🔒 on request
Datasetbigcode/the-stack-smol

Small code slice across 30 languages

A subset of The Stack: 10K random code examples for each of 30 languages, 2.6 GB.

  • Text generation
  • Code
31.5K 107100K–1M rows🔒 on request
DatasetRawvY/stack-prompts

Code training prompt corpus

High-quality data selection for training small programming language models.

  • Text generation
  • English
31.4K 010M–100M rows