Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetksolovev/fine-newsTop pick

Cleaned corpus of 635M news articles in six languages

Large-scale multilingual archive of news articles from 2016–2026 with quality filtering and deduplication.

  • Text generation
  • Text classification
  • Text retrieval
  • English
  • Spanish
  • Russian
  • +9
459.8K 53100M–1B rows
Datasetsecemp9/arxiv-completeTop pick

arXiv Complete: full snapshot of arXiv papers

Snapshot of 3.1 million arXiv papers with metadata, files, and PDFs.

  • Text generation
  • Text retrieval
  • English
116.5K 804100M–1B rows
Datasetopen-index/hacker-news

Full Hacker News archive since 2006

All Hacker News stories, comments, Ask HN, Show HN, jobs, and polls in English.

  • Text generation
  • Embeddings
  • Text classification
  • English
101.5K 60610M–100M rows
Datasetxuejun72/HR-VILAGE-3K3M

HR-VILAGE-3K3M immunization gene profiles

Tabular and text dataset of human gene expression profiles during respiratory viral immunization.

  • Zero shot classification
  • Embeddings
  • Token classification
84.7K 31K–10K rows
Datasettasksource/esci

Product search query relevance benchmark

A large dataset from Amazon with query-product pairs and relevance judgments in three languages to improve search.

  • Text classification
  • Text retrieval
  • English
  • Japanese
  • Spanish
83.1K 101M–10M rows
Datasetchrisrca/clash-royale-tv-replays

Clash Royale TV frame-by-frame match recordings

Clash Royale gameplay screenshots at roughly 10 frames per second for computer vision and game analysis.

  • Embeddings
57.7K 310K–100K rows
Datasetmiracl/miracl-corpus

Multilingual Retrieval Text Corpus

A text corpus in 16 languages from Wikipedia for training and evaluating information retrieval systems.

  • Text retrieval
  • Arabic
  • Bangla
  • English
  • +9
54.8K 5810M–100M rows
Datasetmteb/nfcorpus

NFCorpus medical text retrieval benchmark

Corpus of English medical and scientific texts for evaluating information retrieval models.

  • Text retrieval
  • English
49.7K 3100K–1M rows
Datasetmixed-modality-search/MixBench25

Multimodal Text and Image Search Benchmark

Set of queries and mixed corpora based on MSCOCO, Google_WIT, VisualNews, and OVEN for cross-modal search evaluation.

  • Text ranking
  • English
48.7K 0
Datasetlaion/Scientific-SummariesTop pick

22 million structured scientific article summaries

A massive corpus of scientific paper summaries with OpenAlex metadata and full texts of 5.3 million articles.

  • Summarization
  • Text classification
  • Embeddings
  • English
  • Multilingual
45.2K 3510M–100M rows
DatasetMearman/OpenAlexTop pick

OpenAlex Scientific Database Mirror (250+M Works)

Huge multilingual archive of metadata on scientific papers and authors for feature extraction.

  • Tabular classification
  • Embeddings
  • English
  • Multilingual
45.1K 510B–100B rows
Datasetdatabricks/officeqa

Databricks benchmark for complex financial documents

Q&A based on historical US Treasury bulletins to evaluate AI agents' ability to analyze tables, charts, and text.

  • Question answering
  • Text generation
  • Text retrieval
  • English
35.2K 42up to 1K rows🔒 on request
Datasetnvidia/PhysicalAI-SimReady-Warehouse-01

NVIDIA OpenUSD warehouse 3D assets for simulation

A catalog of simulation-ready 3D warehouse objects and their preview images for robotics and computer vision.

  • Image segmentation
  • Robotics
  • Depth estimation
  • English
34.7K 64up to 1K rows
Datasetxlangai/BRIGHT

BRIGHT: Reasoning-Intensive Search Benchmark

An English text retrieval benchmark featuring queries from StackExchange, LeetCode, and math competitions.

  • Text retrieval
  • English
33.5K 811M–10M rows
Datasetalibabagroup/eMCR

eMCR multi-condition product retrieval benchmark

Official Chinese-language dataset for multi-condition text and visual product retrieval in e-commerce.

  • Text retrieval
  • Visual document retrieval
  • Chinese
30.5K 010K–100K rows
Datasetgoogle/xtreme

XTREME multilingual benchmark

Multilingual pairs for NLI and other tasks: 112.5k annotated pairs across 14 languages.

  • Multiple choice
  • Question answering
  • Token classification
  • Afrikaans
  • Arabic
  • Bulgarian
  • +9
29.1K 1191M–10M rows
Datasettensorfeed/ai-ecosystem-daily

Daily AI Industry, Pricing, and Benchmark Slices

Automatically updated daily digests on the AI market: model and GPU pricing, API latency, news, and benchmarks.

  • Text classification
  • Text generation
  • Embeddings
  • English
26.8K 2100K–1M rows
DatasetRevolutionCrossroads/loc_chronicling_america_1770-1810

OCR Archive of 1770-1810 American Newspapers

Historical US newspaper pages with images, original OCR, and neural text recognition.

  • Image → text
  • Text retrieval
  • Text classification
  • English
26.6K 810K–100K rows
Datasetlaion/laion-audio-xlTop pick

Massive short audio corpus with text captions

Over 366 million audio clips with captions used to train LAION CLAP2 models.

  • Audio classification
  • Text → audio
  • Embeddings
25.5K 91100M–1B rows🔒 on request
Datasetdatabricks/officeqa-pro-v2

OfficeQA Pro v2 document reasoning benchmark

Dataset for evaluating models and agents on US Federal report documents.

  • Question answering
  • Text generation
  • Text retrieval
  • English
25.2K 25up to 1K rows🔒 on request