Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetHuggingFaceFW/finetranslationsTop pick

Parallel texts in 500+ languages

Over 1 trillion tokens of parallel text in English and 500+ languages for machine translation.

  • Text generation
  • Translation
  • Abkhazian
  • abq
  • abs
  • +9
26.9K 3101B–10B rows
Datasettensorfeed/ai-ecosystem-daily

Daily AI Industry, Pricing, and Benchmark Slices

Automatically updated daily digests on the AI market: model and GPU pricing, API latency, news, and benchmarks.

  • Text classification
  • Text generation
  • Embeddings
  • English
26.8K 2100K–1M rows
Datasetopenlanguagedata/flores_plus

FLORES+ multilingual translation benchmark

Parallel texts for machine translation evaluation across numerous languages, including low-resource ones.

  • Text generation
  • Translation
  • Acehnese
  • acm
  • acq
  • +9
26.7K 217100K–1M rows🔒 on request
Datasetnhblk123/helaxai_data_pluse

Large Open Source Code Corpus from GitHub

A GitHub-sourced collection of source code (100M to 1B records) for training code LLMs.

  • Text generation
  • Code
26.4K 1100M–1B rows
Datasetepfml/FineWeb2-HQ-PlusTop pick

Curated texts for 100-language pretraining

Large corpus of the top 10% FineWeb2 documents across 100 languages for high-quality language model pretraining.

  • Text generation
  • German
  • French
  • Polish
  • +9
25.8K 1100M–1B rows
DatasetKodCode/KodCode-V1-SFT-4o

Synthetic coding tasks and tests for SFT

Large open-source English synthetic dataset with verifiable solutions and programming tests.

  • Question answering
  • English
24.5K 10100K–1M rows
Datasetallenai/dolmino-mix-1124

OLMo2 Annealing Data Mix

High-quality mix of web texts, articles, encyclopedias, and code for the second training stage of OLMo2.

  • Text generation
  • English
24.4K 105100M–1B rows
DatasetIntelligenceLab/Long-Horizon-Terminal-Bench

Long-Horizon Terminal Tasks Benchmark

LHTB evaluates how LLM agents maintain useful work in a containerized terminal over hundreds of steps.

  • Text generation
  • English
24.3K 144up to 1K rows
Datasetcompressionawareintelligence/cai-benchTop pick

AI agent pressure resistance benchmark

A 10K–100K example test suite for checking whether an AI agent follows rules under user pressure.

  • Question answering
  • Text classification
  • Text generation
  • English
23.8K 1110K–100K rows🔒 on request
Datasetaliarda/reddit-car-post-and-comments

Reddit car posts and comments

A text corpus from automotive subreddits for model training and analysis.

  • Text classification
  • Text generation
  • Embeddings
  • English
23.6K 010M–100M rows🔒 on request
DatasetOpenFormosa/barbet-long-context-sft

Barbet long-context SFT v4

A large-scale Russian and English text dataset for long-context SFT containing over 10 million records.

  • Text generation
  • Chinese
  • English
23.2K 310M–100M rows
DatasetZF5761/stack-v3-trainTop pick

The Stack v3: giant GitHub source code corpus

Hundreds of millions of source code files with full repository context for pre-training code language models.

  • Text generation
  • Code
22.9K 0100M–1B rows
Datasethashmortar/spreadsheet-bench-v2-modified

Table, PDF, and document question answering

A set of 1,060 questions and reference answers in English across 171 business documents in various formats.

  • Question answering
  • Table question answering
  • Document question answering
  • English
22.8K 21K–10K rows
DatasetKodCode/KodCode-Light-RL-10K

KodCode-Light synthetic coding dataset

A large synthetic dataset featuring verified solutions and tests for programming tasks.

  • Question answering
  • English
22.2K 1010K–100K rows
DatasetHuggingFaceFW/finewiki

Wikipedia in 325 languages: cleaned finewiki

Updated Wikipedia from August 2025 HTML dumps: 325 languages, clean articles and metadata.

  • Text generation
21.9K 34610M–100M rows
Datasetnvidia/Nemotron-Pretraining-Indic-Specialized-v1Top pick

Nemotron-Pretraining-Indic Corpus for Indian Languages

A massive specialized text corpus from NVIDIA containing 100M to 1B records in Indian languages for language model pre-training.

  • Text generation
  • Assamese
  • Bangla
  • Bodo
  • +9
21.3K 7100M–1B rows
DatasetHuggingFaceFW/finepdfs-eduTop pick

Educational PDF Tokens in 69 Languages

350B+ educational PDF tokens filtered by an educational quality classifier.

  • Text generation
  • English
  • German
  • Japanese
  • +9
20.9K 10710M–100M rows
Datasetheitorrosa/cvm-corpus

Brazilian regulator CVM financial report corpus

Cleaned and chunked documents from Brazilian regulator CVM in Portuguese for language model fine-tuning.

  • Text generation
  • Fill mask
  • Portuguese
20K 0100K–1M rows
DatasetZomiLearner/English-Zomi-OPUS_Tatoeba_v20230412Top pick

1.78M phrase parallel corpus: English and Zomi

An open bilingual dataset of 1.78 million sentence pairs for the rare Zomi (Tedim Chin) language and English.

  • Translation
  • English
  • ctd
19.9K 11M–10M rows
DatasetAzzindani/Legal_Corpus_QA_SynDeepThink

Indonesian legal question and answer dataset

A synthetic dataset with Q&A pairs and step-by-step logic verification for legal language models.

  • Text generation
  • Question answering
  • Indonesian
19.9K 11K–10K rows
DatasetSALT-NLP/SWE-chat

Real-world AI coding sessions

Developer dialogues with AI assistants: tool calls, reasoning traces, and code edits.

  • Text generation
  • English
  • Japanese
  • Chinese
  • +3
18.3K 17510M–100M rows🔒 on request