Skip to content

Datasets

Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.

Data type

For which models

Find a dataset for your goal

Answered by Gemini 4 · the chat is kept only in this tab

DatasetHarrysunshine/openalex-abstracts-106mTop pick

OpenAlex abstracts dataset (1980–2026)

Massive corpus of over 106 million English scientific articles and conference papers.

  • Text classification
  • Embeddings
  • English
23K 1100M–1B rows🔒 on request
Datasetmteb/sickr-sts

SICK-R semantic textual similarity for MTEB

An English test set (1K-10K) from the MTEB benchmark for evaluating text embedding quality.

  • Sentence similarity
  • English
22.8K 61K–10K rows
Datasetmteb/NanoMSMARCORetrieval

Compact search embedding evaluation benchmark

A lightweight subset of the famous MS MARCO search dataset for fast embedding model evaluation in MTEB.

  • Text retrieval
  • English
22.4K 01K–10K rows
DatasetNuBerea/reformationTop pick

Reformation reception corpus with OCR

A corpus of Reformation-era texts featuring page-grain OCR, annotation, and lemmas in multiple languages.

  • Embeddings
  • Latin
  • English
  • German
  • +1
22K 110M–100M rows🔒 on request
Datasetmteb/sts22-crosslingual-sts

Multilingual news similarity benchmark (STS22.v2)

Cleaned set of multilingual news article pairs for evaluating text embedding models.

  • Sentence similarity
  • Arabic
  • Chinese
  • German
  • +7
21.5K 1610K–100K rows
DatasetNousResearch/hermes-function-calling-v1

Function calling and JSON-mode dataset

Dialogues for training LLMs in function calling, JSON mode, and structured extraction.

  • Text generation
  • Question answering
  • Embeddings
  • English
20.9K 51310K–100K rows
Datasetphilippesaade/Wikidata_Vectors_0.2Top pick

Wikidata entity and property vector embeddings

Tens of millions of vectors for Wikidata elements in 4 languages from Wikimedia, Jina AI, and IBM.

  • Embeddings
  • Text retrieval
  • Text classification
  • English
  • Arabic
  • French
  • +1
20.6K 410M–100M rows
Datasetmteb/sts14-sts

STS14 semantic textual similarity benchmark

The classic SemEval STS 2014 English dataset within MTEB for evaluating text embedding quality.

  • Sentence similarity
  • English
19.9K 21K–10K rows
Datasetedwarddgao/open-apply-jobs

Daily updated active IT job database from ATS

English-language corpus of current job postings directly from hiring system APIs for text search and classification tasks.

  • Text classification
  • Text retrieval
  • English
19.8K 1010M–100M rows
DatasetW8Yi/tcga-wsi-uni2h-features

TCGA histological image embeddings (UNI2-h)

Extracted feature representations of TCGA histological images for computational pathology research.

  • Image feature extraction
  • English
19.6K 15up to 1K rows
Datasetscholarweave/arxiv-latexTop pick

ArXiv LaTeX sources with metadata

The complete corpus of arXiv LaTeX sources, parsed and aligned with official metadata in Parquet format.

  • Text generation
  • Embeddings
  • English
18.9K 1501M–10M rows
Datasetdell-research-harvard/AmericanStories

Structured US historical newspapers

Structured historical English newspaper texts for LLM pre-training and RAG.

  • Text classification
  • Text generation
  • Text retrieval
  • English
16.8K 184100M–1B rows
Datasetgoogle/svq

Short Spoken Questions in 17 Languages

Audio questions across 26 locales to evaluate ASR, audio search, and audio embeddings.

  • Question answering
  • Automatic speech recognition
  • Text retrieval
  • Arabic
  • Bangla
  • English
  • +9
14.1K 681M–10M rows
Datasetibm-esa-geospatial/TerraMeshTop pick

TerraMesh Geospatial Satellite Dataset

Over 9 million co-registered satellite imagery and geospatial data patches by IBM and ESA.

  • Image feature extraction
14.1K 351M–10M rows
Datasetscholarweave/Jobs-Dataset-v2

Open jobs dataset with hiring history

Database of current job postings and change history from company sites for labor market analysis.

  • Text classification
  • Sentence similarity
  • Token classification
  • English
13.8K 31M–10M rows
Datasetwikimedia/wit_base

Multilingual image-text pairs from Wikipedia

Image and text connections from Wikipedia across many languages for training and evaluating multimodal retrieval.

  • Image → text
  • Text retrieval
  • Afrikaans
  • Aragonese
  • Arabic
  • +9
12.5K 77100K–1M rows
Datasetjiawennnn/STimage-1K4M

Histopathology and gene expression for transcriptomics

High-resolution tissue images and gene expression data for biomedical models.

  • Image feature extraction
  • Image segmentation
  • Image classification
  • English
12.4K 36100B–1T rows
Datasetomegalabsinc/omega-multimodal

Multimodal video dataset from the Bittensor network

A massive video corpus with text descriptions and tabular metadata from the decentralized OMEGA Labs network.

  • Video text → text
  • Video classification
  • Image classification
11.3K 61
DatasetCanCLID/zoengjyutgaai

Cantonese audiobooks and transcriptions

Recordings by famous storyteller Zhang Yuekai with verified texts for Cantonese TTS and ASR.

  • Automatic speech recognition
  • Text → speech
  • Text generation
  • Cantonese
10.5K 35100K–1M rows