Multilingual Retrieval Corpus
Multilingual retrieval corpus: document collections, query topics, and qrels across 18 languages.
- Text retrieval
- Arabic
- Bangla
- English
- +9
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
Multilingual retrieval corpus: document collections, query topics, and qrels across 18 languages.
English dataset from the MTEB suite for evaluating evidence retrieval in scientific publications and medical texts.
Machine-readable archive of the Royal Thai Government Gazette for Legal Tech and QA tasks.
Vietnamese e-commerce data with product photos, descriptions, user reviews, and review images.
1,000 to 10,000 images for training and validating few-shot object counting models across any class.
Corpus of news articles in various languages reconstructed from GDELT for search, generation, and text classification.
Q&A based on historical US Treasury bulletins to evaluate AI agents' ability to analyze tables, charts, and text.
A catalog of simulation-ready 3D warehouse objects and their preview images for robotics and computer vision.
An English text retrieval benchmark featuring queries from StackExchange, LeetCode, and math competitions.
1,276 spatial transcriptomics profiles aligned with whole-slide images for multimodal tasks.
Archive of over 11,000 past exam questions from Ramdeobaba University for text-retrieval tasks.
Raw legal text corpus for language model pre-training, feature extraction, and search.
Official Chinese-language dataset for multi-condition text and visual product retrieval in e-commerce.
Multilingual pairs for NLI and other tasks: 112.5k annotated pairs across 14 languages.
Automatically updated daily digests on the AI market: model and GPU pricing, API latency, news, and benchmarks.
Historical US newspaper pages with images, original OCR, and neural text recognition.
Over 366 million audio clips with captions used to train LAION CLAP2 models.
Dataset for evaluating models and agents on US Federal report documents.
Machine-readable texts from public court and government archives for information retrieval and feature extraction.
Over 153k high-resolution aligned photos and tabular measurements of 8 characteristics across 4k wheat plots.
Digitized collection of 8,589 Arabic books across 40 categories of classical Islamic sciences.
A text corpus from automotive subreddits for model training and analysis.
10k to 100k digitized multi-page National Archives documents in English.
Large DataComp-1B image-text corpus with improved captions from LLaVA-1.5-LLaMA3-8B.