OpenAlex abstracts dataset (1980–2026)
Massive corpus of over 106 million English scientific articles and conference papers.
- Text classification
- Embeddings
- English
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
Massive corpus of over 106 million English scientific articles and conference papers.
An English test set (1K-10K) from the MTEB benchmark for evaluating text embedding quality.
A lightweight subset of the famous MS MARCO search dataset for fast embedding model evaluation in MTEB.
A corpus of Reformation-era texts featuring page-grain OCR, annotation, and lemmas in multiple languages.
Cleaned set of multilingual news article pairs for evaluating text embedding models.
English medical text pairs for evaluating embedding quality in MTEB.
Dialogues for training LLMs in function calling, JSON mode, and structured extraction.
English text pairs from web and news for evaluating embedding models in MTEB.
Tens of millions of vectors for Wikidata elements in 4 languages from Wikimedia, Jina AI, and IBM.
SmolLM/SmolLM2 text fragments and FAISS vector indices for evaluating LLM generation novelty.
The classic SemEval STS 2014 English dataset within MTEB for evaluating text embedding quality.
English-language corpus of current job postings directly from hiring system APIs for text search and classification tasks.
Large corpus of 3D surface meshes generated from closed curves with genus 0 to 10.
Extracted feature representations of TCGA histological images for computational pathology research.
A set of text pairs from the MTEB benchmark to evaluate the quality of finding the best counter-argument without topic knowledge.
The complete corpus of arXiv LaTeX sources, parsed and aligned with official metadata in Parquet format.
Structured historical English newspaper texts for LLM pre-training and RAG.
Audio questions across 26 locales to evaluate ASR, audio search, and audio embeddings.
Over 9 million co-registered satellite imagery and geospatial data patches by IBM and ESA.
Database of current job postings and change history from company sites for labor market analysis.
Image and text connections from Wikipedia across many languages for training and evaluating multimodal retrieval.
High-resolution tissue images and gene expression data for biomedical models.
A massive video corpus with text descriptions and tabular metadata from the decentralized OMEGA Labs network.
Recordings by famous storyteller Zhang Yuekai with verified texts for Cantonese TTS and ASR.