Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetKaLM-Embedding/KaLM-embedding-finetuning-data

Multilingual triplets for KaLM embedding training

From 1 to 10M examples with positive and negative pairs in English, Chinese, and other languages for embedding model fine-tuning.

  • Embeddings
  • English
  • Chinese
524 331M–10M rows
DatasetKBlueLeaf/danbooru2023-metadata-database

Danbooru2023 Metadata in SQLite

An SQLite database of Danbooru2023 tags and posts with a latest ID of 7,866,491 for generative models.

  • Image classification
  • Text → image
  • Image → text
  • English
  • Japanese
522 841M–10M rows🔒 on request
Datasetreasonir/reasonir-data

Synthetic data for ReasonIR reasoning search

English dataset with complex queries and texts of varying lengths used to train the ReasonIR-8B retriever.

  • Text retrieval
  • English
493 36100K–1M rows
Datasettheislab/CAMEO-Breast

CAMEO-Breast: Multimodal Breast Cancer Benchmark

A multimodal benchmark of H&E patches and gene expression profiles for image classification tasks.

  • Image classification
  • Embeddings
  • English
489 5100K–1M rows🔒 on request
Datasetankitjh4/bharat-government-documents

Indian government reference documents

A cleaned corpus of official public Indian documents in parquet format for search and question-answering systems.

  • Question answering
  • Text retrieval
476 6510K–100K rows
DatasetOpenGVLab/InternVid

10M video-caption pairs InternVid-10M-FLT

10 million video clips with automatically generated captions and UMT scores for video-text tasks.

  • Embeddings
  • English
438 10110M–100M rows🔒 on request
Datasetmathieu1256/FATURA2-invoices

FATURA2 invoice dataset for NER

Dataset of 20,000 invoice images with named entity recognition markup and JSON annotations.

  • Embeddings
  • English
372 2210K–100K rows
Datasettandevllc/offsec_redteam_info

Cybersecurity text corpus

English text corpus of approximately 1.6B tokens covering red-team and blue-team topics.

  • Text generation
  • Text retrieval
  • Text ranking
  • English
351 341M–10M rows🔒 on request
Dataset5CD-AI/Vietnamese-THUIR-T2Ranking-gg-translated

Vietnamese passage ranking dataset

A large-scale Vietnamese corpus for information retrieval and text ranking tasks.

  • Text retrieval
  • Sentence similarity
  • Text classification
  • Vietnamese
  • Chinese
297 23100M–1B rows
Datasetymoslem/Law-StackExchange

Legal questions and answers from Law StackExchange

An archive of all questions and answers from the Law section of StackExchange in English up to August 2023.

  • Question answering
  • Text classification
  • Sentence similarity
  • English
277 3210K–100K rows
DatasetMuskumPillerum/General-Knowledge

General knowledge and reasoning QA pairs

10k to 100k general knowledge and reasoning question-answer pairs.

  • Text classification
  • Question answering
  • Text generation
231 5210K–100K rows
DatasetMineAITechnology/mine-embed-v1

Embedding model training data (EN/UR)

An experimental English and Urdu bilingual corpus for MLM pre-training and contrastive embedding tuning.

  • Embeddings
  • Sentence similarity
  • English
  • Urdu
217 7up to 1K rows
Datasetrlacombe/ClimateX

Climate claims expert evaluation dataset

8,094 IPCC report statements with expert annotation for evaluating LLM climate knowledge.

  • Zero shot classification
  • Text classification
  • Embeddings
  • English
189 81K–10K rows
DatasetJDhruv14/Bhagavad-Gita_Dataset

Bhagavad Gita parallel corpus (Sanskrit, Hindi, English)

Bhagavad Gita verses in Sanskrit with Hindi and English translations for translation and generation tasks.

  • Translation
  • Text generation
  • Embeddings
  • Hindi
  • Sanskrit
  • English
173 63up to 1K rows
DatasetShimizuYuki/Marvel_network

Marvel universe character social graph

Tabular dataset on connections and co-occurrences of Marvel comic book heroes.

  • Embeddings
  • English
169 39100K–1M rows
Datasetlouisbrulenaudet/legalkit

Labeled French legal texts (LegalKit)

A French dataset labeled by LLaMA-3-70B for training embeddings and legal QA.

  • Question answering
  • Sentence similarity
  • French
155 3710K–100K rows
DatasetSilentAntagonist/vintage-photography-450k-high-quality-captions

450k vintage 20th-century photographs with captions

A high-resolution collection of 20th-century analog photos, with detailed descriptions already generated for 20k of them.

  • Image classification
  • Image feature extraction
  • Text → image
  • English
138 36100K–1M rows
Datasetglnmario/news-qa-summarization

CNN news articles with questions and summaries

A CNN news corpus for simultaneous training and evaluation of summarization and QA retrieval.

  • Summarization
  • Question answering
  • Text retrieval
  • English
100 3910K–100K rows
Datasetronantakizawa/github-top-developers

Top GitHub developers by year

Ranking of 8,125 GitHub developers for 2015-2025 based on Wayback Machine data.

  • Text classification
  • Time series forecasting
  • Text retrieval
  • English
95 7210K–100K rows
Datasetsc890/DEEPFRUlT_DATASET

Labeled dataset of 20 fruit varieties

Over 21,000 fruit images with pre-split train/test sets and CSV annotations.

  • Embeddings
  • Text classification
  • English
91 4610K–100K rows
Datasetbrianarbuckle/cocktail_recipes

Cocktail Recipes with Ingredient Lists

A small set of semi-structured English cocktail recipes for text generation.

  • Text generation
  • Fill mask
  • Text retrieval
  • English
90 15up to 1K rows
Datasetsunlab/patch_db

PatchDB security patch dataset

A corpus of over 35,000 patches for security research and vulnerability patching.

  • Embeddings
  • Text classification
  • Summarization
  • English
85 2910K–100K rows🔒 on request