Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetopen-index/open-github

GitHub public events and activity archive

Tabular and text data on pushes, pull requests, releases, and discussions from public repositories.

  • Text generation
  • Text classification
  • Embeddings
  • English
  • Multiple languages
3.1K 12100K–1M rows
Datasetopen-index/open-arxiv

Complete metadata of nearly 3 million arXiv papers

Metadata of 2.99 million scientific publications from 1991 to 2026 in parquet format for search and analytics.

  • Text classification
  • Text generation
  • Embeddings
  • English
  • Multilingual
2.9K 211M–10M rows
DatasetICVL-BGU/ICVL_HS_2016

Hyperspectral images of natural and urban scenes

Collection of 202 high-resolution hyperspectral images in the 400-1000 nm range for computer vision tasks.

  • Image → image
  • Image feature extraction
2.8K 17up to 1K rows🔒 on request
DatasetPRAIG/SMB

Sheet music recognition (OMR) benchmark

Printed sheet music images with region annotations for testing optical music recognition systems.

  • Image → text
  • Image segmentation
  • Text retrieval
2.5K 17up to 1K rows🔒 on request
DatasetHello-SimpleAI/HC3-Chinese

Comparison of human and ChatGPT answers in Chinese

Text corpus for comparing human and ChatGPT answers; suitable for classification and similarity evaluation.

  • Text classification
  • Question answering
  • Sentence similarity
  • English
  • Chinese
2.5K 18610K–100K rows
Datasettdiggelm/climate_fever

Climate change claim fact-checking dataset

1,535 climate claims from the internet and 7,675 annotated evidence sentences from English Wikipedia.

  • Text classification
  • Text retrieval
  • English
2.4K 341K–10K rows
Datasetopen-index/open-wikipedia-markdownTop pick

Cleaned Wikipedia across all languages in Markdown format

Articles from all Wikipedia language editions, cleaned of MediaWiki markup and converted to pure Markdown.

  • Text generation
  • Embeddings
  • Text classification
  • Bhojpuri
  • Hiri Motu
  • kge
  • +9
2.2K 2310M–100M rows
DatasetShitao/MLDR

Multilingual Long-Document Retrieval

A long-document retrieval dataset in 13 languages with GPT-3.5-generated questions.

  • Text retrieval
  • Arabic
  • German
  • English
  • +9
2.1K 83
Datasetonyx-dot-app/EnterpriseRAG-Bench

Benchmark for evaluating corporate RAG

Over 500,000 documents and 500 English questions for testing RAG systems on business data.

  • Question answering
  • Text retrieval
  • English
2.1K 27up to 1K rows
Datasetopen-index/open-library

Complete Open Library book catalog in parquet

Over 150 million bibliographic records from the Open Library project for NLP, search, and data extraction tasks.

  • Text generation
  • Embeddings
  • Text classification
  • English
  • Multiple languages
2.1K 11100M–1B rows
Datasetrag-datasets/rag-mini-wikipedia

Mini Wikipedia for QA and phrase similarity search

A small English text dataset for question-answering tasks and sentence semantic similarity comparison.

  • Question answering
  • Sentence similarity
  • English
2K 711K–10K rows
DatasetCareerflow/ResumeBench

Benchmark for resume parsing

Benchmark for evaluating the accuracy of structured data extraction from resumes by JSON Schema.

  • Document question answering
  • Embeddings
  • English
1.9K 2up to 1K rows🔒 on request
Datasetvaquill/open-india-lawTop pick

Indian laws and court judgments corpus

Large structured archive of Indian judicial acts, tribunal decisions, and legislation in English.

  • Text retrieval
  • Question answering
  • Text classification
  • English
1.8K 4810M–100M rows🔒 on request
Datasetkishormorol/researchscope-papers

Computer science research paper corpus and SFT splits

A database of 34,831 computer science research papers with section splits and ready-to-use fine-tuning data.

  • Text generation
  • Summarization
  • Embeddings
  • English
1.7K 5100K–1M rows
DatasetBrianferrell787/financial-news-multisource

Financial and general news, 57m rows

A unified corpus of 24 public news datasets: 57.1 million rows with English dates and text.

  • Text classification
  • Text retrieval
  • Other
  • English
1.6K 12310M–100M rows🔒 on request
Datasetrag-datasets/rag-mini-bioasq

Biomedical dataset for RAG testing

Cleaned subset of biomedical texts and English questions for evaluating search and generation systems.

  • Question answering
  • Sentence similarity
  • English
1.5K 5610K–100K rows
Datasetvaquill/open-us-lawTop pick

Large US legislation corpus in English

Over 5 million sections of US laws, regulations, and prosecutor opinions for search and analysis.

  • Text retrieval
  • Question answering
  • Text classification
  • English
1.4K 341M–10M rows🔒 on request
DatasetAmber-River/Pixiv-2.6M

2.6M Pixiv illustrations and tags collection

Large image corpus from Pixiv in English and Japanese for generation and tagging.

  • Image classification
  • Image → text
  • Image → image
  • English
  • Japanese
1.3K 481M–10M rows🔒 on request
DatasetLouisChen15/ConstructionSite

Annotated construction sites

10,013 construction site images with annotations for evaluating scene understanding in vision-language models.

  • Image → text
  • Image feature extraction
  • English
1.2K 8410K–100K rows🔒 on request
Datasetagentlans/high-quality-english-sentences

Cleaned English sentences from C4 and FineWeb

A spam-filtered corpus of millions of English sentences for text tasks.

  • Text classification
  • Text generation
  • Embeddings
  • English
1.2K 411M–10M rows