Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetisaacus/open-australian-legal-corpusTop pick

Open Australian legal corpus

229,122 Australian legal documents in English: legislation and judicial acts.

  • Text generation
  • Fill mask
  • Text retrieval
  • English
7.3K 109100K–1M rows
Datasetfacebook/kilt_tasks

KILT benchmark on Wikipedia

11 datasets for fact-checking, QA, entity linking, and dialogue on a single Wikipedia dump.

  • Fill mask
  • Question answering
  • Text classification
  • English
7.1K 691M–10M rows
Datasetdell-research-harvard/newswire

Historical US wire service news

2.7 million US wire service articles from 1878-1977 with geolocation, topics, and entities.

  • Text classification
  • Text generation
  • Text retrieval
  • English
6.9K 951M–10M rows
DatasetHello-SimpleAI/HC3

HC3: humans vs. ChatGPT

A corpus of human and ChatGPT answers for comparison and text detection.

  • Text classification
  • Question answering
  • Sentence similarity
  • English
  • Chinese
6.7K 24410K–100K rows
Datasetjamescalam/youtube-transcriptions

Technical YouTube Tutorial Transcriptions

Short text snippets from English video tutorials with timestamps for search and RAG.

  • Question answering
  • Text retrieval
  • Visual question answering
  • English
6.5K 44100K–1M rows
Datasetyixuantt/MultiHopRAG

MultiHop-RAG: Document RAG QA benchmark

2556 queries with evidence across 2 to 4 documents to test RAG retrieval and reasoning.

  • Question answering
  • Embeddings
  • English
6.5K 771K–10K rows
Datasetgfissore/arxiv-abstracts-2021

Abstracts of all arXiv papers through end of 2021

About 2 million titles, abstracts, and metadata of scientific papers from arXiv in English.

  • Summarization
  • Text retrieval
  • English
6.4K 411M–10M rows
DatasetBeIR/msmarco

English Text Retrieval Benchmark (BEIR)

A subset of MS MARCO in the BEIR benchmark format of millions of English documents and search queries.

  • Zero shot classification
  • Text retrieval
  • English
5.3K 161M–10M rows
DatasetTHUIR/Qilin

Multimodal user session dataset for RAG and search

Large Chinese dataset (1M to 10M) for search, recommendations, and RAG systems.

  • Question answering
  • Text classification
  • Sentence similarity
  • Chinese
5.3K 441M–10M rows
Datasetmaharshipandya/spotify-tracks-dataset

Spotify tracks: 125 genres

Tabular audio features of Spotify tracks across 125 genres in CSV format.

  • Embeddings
  • Tabular classification
  • Tabular regression
  • English
4.6K 141100K–1M rows
Datasetsentence-transformers/all-nli

Combined NLI corpus for embedding training

Millions of English sentence pairs with logical inference labels for training semantic similarity models.

  • Embeddings
  • Sentence similarity
  • English
4.5K 541M–10M rows
Datasetsentence-transformers/natural-questions

Natural Questions question-answer pairs for embeddings

English question-answer pairs in Sentence Transformers format for training search and semantic similarity models.

  • Embeddings
  • Sentence similarity
  • English
3.6K 52100K–1M rows
Datasetopen-index/open-github

GitHub public events and activity archive

Tabular and text data on pushes, pull requests, releases, and discussions from public repositories.

  • Text generation
  • Text classification
  • Embeddings
  • English
  • Multiple languages
3.1K 12100K–1M rows
Datasetopen-index/open-arxiv

Complete metadata of nearly 3 million arXiv papers

Metadata of 2.99 million scientific publications from 1991 to 2026 in parquet format for search and analytics.

  • Text classification
  • Text generation
  • Embeddings
  • English
  • Multilingual
2.9K 211M–10M rows
DatasetPRAIG/SMB

Sheet music recognition (OMR) benchmark

Printed sheet music images with region annotations for testing optical music recognition systems.

  • Image → text
  • Image segmentation
  • Text retrieval
2.5K 17up to 1K rows🔒 on request
DatasetHello-SimpleAI/HC3-Chinese

Comparison of human and ChatGPT answers in Chinese

Text corpus for comparing human and ChatGPT answers; suitable for classification and similarity evaluation.

  • Text classification
  • Question answering
  • Sentence similarity
  • English
  • Chinese
2.5K 18610K–100K rows
Datasettdiggelm/climate_fever

Climate change claim fact-checking dataset

1,535 climate claims from the internet and 7,675 annotated evidence sentences from English Wikipedia.

  • Text classification
  • Text retrieval
  • English
2.4K 341K–10K rows
DatasetCareerflow/ResumeBench

Benchmark for resume parsing

Benchmark for evaluating the accuracy of structured data extraction from resumes by JSON Schema.

  • Document question answering
  • Embeddings
  • English
2.2K 3up to 1K rows🔒 on request
Datasetonyx-dot-app/EnterpriseRAG-Bench

Benchmark for evaluating corporate RAG

Over 500,000 documents and 500 English questions for testing RAG systems on business data.

  • Question answering
  • Text retrieval
  • English
2.1K 27up to 1K rows
Datasetopen-index/open-library

Complete Open Library book catalog in parquet

Over 150 million bibliographic records from the Open Library project for NLP, search, and data extraction tasks.

  • Text generation
  • Embeddings
  • Text classification
  • English
  • Multiple languages
2.1K 11100M–1B rows
Datasetrag-datasets/rag-mini-wikipedia

Mini Wikipedia for QA and phrase similarity search

A small English text dataset for question-answering tasks and sentence semantic similarity comparison.

  • Question answering
  • Sentence similarity
  • English
2K 711K–10K rows