Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

Datasetkatanaml-org/invoices-donut-data-v1

Labeled invoices for the Donut model

Small set of 500 English electronic invoices with ready annotations for extracting structured data from documents.

  • Embeddings
  • English
1.2K 45up to 1K rows
Datasetwaterdisappear/ATRNet-STAR

Remote sensing object recognition benchmark

A large dataset for classification, detection, and feature extraction of objects in remote sensing imagery.

  • Embeddings
  • Image classification
  • Object detection
1K 38🔒 on request
Datasettandevllc/offsec_redteam_codesTop pick

Code corpus for pentesting and offensive security

A massive corpus of ~30 billion tokens from GitHub repositories on pentesting, OSINT, vulnerability exploitation, and forensics.

  • Text generation
  • Fill mask
  • Text retrieval
  • English
1K 241M–10M rows🔒 on request
Datasetbigpictureio/companies-2023-q4-sm

Database of 17+ million global companies

Large directory of profiles for over 17 million global companies with domains, industries, and geography.

  • Embeddings
  • English
972 1510M–100M rows
Datasetarxiv-community/arxiv_dataset

1.7M arXiv papers for search and analysis

A corpus of 1.7 million English arXiv papers for recommendations, trend analysis, and semantic search.

  • Translation
  • Summarization
  • Text retrieval
  • English
934 1391M–10M rows
Datasetnvidia/embed-nemotron-dataset-v1Top pick

Data for training NVIDIA embedding models

Multilingual compilation of datasets for fine-tuning embeddings for retrieval, reranking, similarity, and classification.

  • Text retrieval
  • Text ranking
  • Sentence similarity
  • Multilingual
921 11310M–100M rows
DatasetsimpleG2023/chinese-materials-science-open-intelligence

Chinese Materials Science Research Summaries and Tables

Structured reviews of Chinese research in materials science, semiconductors, and metallurgy with tables and QA pairs.

  • Text retrieval
  • Question answering
  • Table question answering
  • English
  • Chinese
763 3up to 1K rows🔒 on request
Datasetd0rj/geo-reviews-dataset-2023Top pick

500k Russian Organization Reviews from Yandex Maps

Large cleaned corpus of real Russian-language reviews from 2023 for NLP tasks.

  • Text classification
  • Sentence similarity
  • Token classification
  • Russian
759 4100K–1M rows
Datasetyachay/text_coordinates_regions

Multilingual geo-tagged social media posts

A corpus of 500,000 multilingual texts linked to geographic coordinates across 123 regions.

  • Embeddings
  • Token classification
  • Text classification
  • English
  • Chinese
  • Spanish
  • +9
683 11100K–1M rows
Datasetatalaydenknalbant/video-games-dataset

Video games database from the RAWG portal

Structured descriptions, ratings, tags, and video game metadata from the RAWG API for analytics and recommendation systems.

  • Sentence similarity
  • Summarization
  • Embeddings
679 32100K–1M rows
Datasetlouisbrulenaudet/clinical-trials

Clinical trials database with embeddings

Records from ClinicalTrials.gov with metadata and pre-computed embeddings for biomedical tasks.

  • Question answering
  • Embeddings
  • Text classification
  • English
  • French
  • Spanish
675 42100K–1M rows
Datasetsteamcyclone/Pill_Ideologies-Post_Titles

Pill ideologies subreddits post dataset

A dataset of English-language texts for studying discussions on Pill Ideologies subreddits.

  • Text classification
  • Summarization
  • Embeddings
  • English
630 141K–10K rows
Datasetsentence-transformers/codesearchnet

Millions of comment-code pairs for embeddings

1 to 10 million pairs of text descriptions and code snippets across various programming languages.

  • Embeddings
  • Sentence similarity
  • English
587 201M–10M rows
Datasetopen-index/open-npmTop pick

Complete archive of npm registry package metadata

A massive snapshot of all Node.js packages from the npm registry with versions, dependencies, and download statistics.

  • Text classification
  • Embeddings
  • English
560 410M–100M rows
Datasetopen-index/hacker-news-rss

Catalog of RSS feeds for all Hacker News domains

623,957 discovered RSS/Atom feeds from 1.75M Hacker News websites in parquet format.

  • Text classification
  • Embeddings
  • English
536 4100K–1M rows
DatasetExploration-Lab/IL-TUR

Indian law benchmark across six languages

From 100K to 1M examples across 8 legal tasks in English and Indian languages.

  • Text classification
  • Summarization
  • Translation
  • English
  • Hindi
  • Bangla
  • +7
529 37100K–1M rows🔒 on request
DatasetKaLM-Embedding/KaLM-embedding-finetuning-data

Multilingual triplets for KaLM embedding training

From 1 to 10M examples with positive and negative pairs in English, Chinese, and other languages for embedding model fine-tuning.

  • Embeddings
  • English
  • Chinese
524 331M–10M rows
DatasetKBlueLeaf/danbooru2023-metadata-database

Danbooru2023 Metadata in SQLite

An SQLite database of Danbooru2023 tags and posts with a latest ID of 7,866,491 for generative models.

  • Image classification
  • Text → image
  • Image → text
  • English
  • Japanese
522 841M–10M rows🔒 on request
Datasetmbien/recipe_nlg

Largest recipe corpus

Over 2.23 million cleaned cooking recipes in English for text generation and search.

  • Text generation
  • Fill mask
  • Text retrieval
  • English
513 541M–10M rows
Datasetreasonir/reasonir-data

Synthetic data for ReasonIR reasoning search

English dataset with complex queries and texts of varying lengths used to train the ReasonIR-8B retriever.

  • Text retrieval
  • English
493 36100K–1M rows
Datasettheislab/CAMEO-Breast

CAMEO-Breast: Multimodal Breast Cancer Benchmark

A multimodal benchmark of H&E patches and gene expression profiles for image classification tasks.

  • Image classification
  • Embeddings
  • English
489 5100K–1M rows🔒 on request
Datasetankitjh4/bharat-government-documents

Indian government reference documents

A cleaned corpus of official public Indian documents in parquet format for search and question-answering systems.

  • Question answering
  • Text retrieval
486 6510K–100K rows