Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetHuggingFaceFW/finephrase

FineWeb-Edu Synthetic Phrases

English synthetic text data generated by SmolLM2 from the FineWeb-Edu corpus.

  • Text generation
  • English
185.3K 1651B–10B rows
DatasetHelsinki-NLP/fineweb-edu-translatedTop pick

Translated FineWeb-Edu Educational Corpus

Over 36.7 million FineWeb-Edu documents automatically translated into 36 languages for training multilingual LLMs and translation systems.

  • Translation
  • Text generation
  • Bosnian
  • Bulgarian
  • Catalan
  • +9
184K 281B–10B rows
Datasetallenai/openbookqa

OpenBookQA: open book questions

English QA benchmark with questions requiring multi-step reasoning and general knowledge.

  • Question answering
  • English
162.9K 16210K–100K rows
Datasetrajpurkar/squad

SQuAD: Wikipedia questions

Reading comprehension QA dataset: questions on Wikipedia articles with span answers.

  • Question answering
  • English
158.5K 89210K–100K rows
Datasetmanu/project_gutenberg

Project Gutenberg books

Over 70k free books in multiple languages for text generation.

  • Text generation
  • French
  • English
  • Chinese
  • +8
155.2K 7710K–100K rows
Datasetproject-numina/NuminaMath-CoT

860k Math Problems with Reasoning

860k math problems with step-by-step Chain of Thought solutions for training reasoning models.

  • Text generation
  • English
146.4K 624100K–1M rows
Datasetjat-project/jat-dataset

Multimodal data for a general agent

A mix of expert RL demonstrations, image-caption pairs, and text for training a multimodal agent.

  • Reinforcement learning
  • Text generation
  • Question answering
128.3K 89100M–1B rows
Datasetnebius/SWE-rebench-V2Top pick

GitHub SWE tasks for agents

32k tasks from real GitHub issues and PRs across 11 languages for training and evaluating SWE agents.

  • Text generation
  • English
126.9K 7710K–100K rows
DatasetBenchCAD/BenchCAD

Multimodal CAD modeling dataset and benchmark

A three-configuration set featuring CadQuery 3D code, part renders, editing tasks, and CAD QA.

  • Image → text
  • Text generation
  • Question answering
125.7K 2310K–100K rows
DatasetHuggingFaceCode/stack-v3-trainTop pick

The Stack v3: GitHub code for LLM training

Largest open source code collection from GitHub with full repository context for pre-training code LLMs.

  • Text generation
  • Code
123.2K 404100M–1B rows
Datasetsecemp9/arxiv-completeTop pick

arXiv Complete: full snapshot of arXiv papers

Snapshot of 3.1 million arXiv papers with metadata, files, and PDFs.

  • Text generation
  • Text retrieval
  • English
122.9K 804100M–1B rows
Datasetallenai/sciq

SciQ science multiple-choice questions

13,679 crowd-sourced physics, chemistry, and biology exam questions with 4 answer choices and explanations.

  • Question answering
  • English
120K 17010K–100K rows
DatasetHPLT/HPLT2.0_cleaned

Cleaned HPLT 2.0 web corpus in 191 languages

Billions of cleaned web documents from Internet Archive and Common Crawl in 191 world languages.

  • Fill mask
  • Text generation
  • Acehnese
  • Afrikaans
  • Albanian
  • +9
119.3K 551B–10B rows
DatasetIFM/Math-ReasoningTop pick

Math problem-solving and reasoning data

Large corpus of math problems, rewrites, and dialogues for training reasoning language models.

  • Text generation
117.2K 391B–10B rows
Datasetnvidia/OpenMathInstruct-2Top pick

OpenMathInstruct-2: 14M Math Pairs

14 million math problem-solution pairs generated by Llama 3.1 405B for instructional fine-tuning.

  • Question answering
  • Text generation
  • English
116K 27110M–100M rows
Datasetbigcode/the-stack

The Stack source code corpus

A large source code corpus in dozens of programming languages with permissive licenses.

  • Text generation
  • Code
115.1K 1.1K100M–1B rows🔒 on request
Datasetopen-index/hacker-news

Full Hacker News archive since 2006

All Hacker News stories, comments, Ask HN, Show HN, jobs, and polls in English.

  • Text generation
  • Embeddings
  • Text classification
  • English
103.2K 60610M–100M rows
Datasetsemianalysisai/cc-traces-weka-062126

Claude Code session logs by SemiAnalysis

Filtered traces of the Claude Code agent CLI without images and service classifier calls.

  • Text generation
102.6K 22up to 1K rows
Datasettruthfulqa/truthful_qa

TruthfulQA: LLM truthfulness benchmark

817 questions across 38 categories to test whether a model generates truthful answers.

  • Multiple choice
  • Text generation
  • Question answering
  • English
96.7K 3021K–10K rows
Datasetmandarjoshi/trivia_qa

TriviaQA: question answering with evidence

650K+ question-answer-evidence triples for English reading comprehension and QA.

  • Question answering
  • English
96.1K 216100K–1M rows
Datasettatsu-lab/alpaca

Alpaca instructions for language models

52k instructions and demonstrations from text-davinci-003 for instruction-tuning language models.

  • Text generation
  • English
92.2K 1.4K10K–100K rows