Multimodal image-text corpus for scene understanding
Large-scale English image-text dataset for unified multimodal model training.
- Multimodal
- English
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
Large-scale English image-text dataset for unified multimodal model training.
Visual math problem benchmark for multimodal LLMs.
7,041 dermatology cases with medical descriptions and Chain-of-Thought reasoning.
Multimodal instructions in English and Chinese for training vision-language models; 1 to 10 million examples.
A large Physical AI dataset with 3D room scans and egocentric recordings in a unified metric system.
Test suite from Moonshot AI for evaluating basic visual perception in multimodal models.
10 demonstration tasks from Google DeepMind for evaluating AI agents working with complex graphics and documents.
Multi-phase abdominal CT scans with lab panels, reports, organ masks, and tumor masks.
Large-scale corpus of image-text pairs where caption phrases are grounded to corresponding image regions.
A large geospatial dataset with temporally and spatially aligned imagery from five satellite sensors.
A collection of generated images and question-answer pairs based on executable code from AllenAI.
Data for proactive robotic manipulation with audio and multimodal context.
A large collection of image-centric data for training and evaluating vision-language models; subsets in JSONL with descriptions.
A high-quality and diverse dataset of approximately 2 million text-image pairs for text-to-image training.
Cartoons and captions from the New Yorker contest for evaluating humor understanding in models.
A set of 16,288 tests across 2,937 pages for evaluating the accuracy of text, table, and layout recognition.
Preference score data and text feedback for aligning models across text, images, audio, and tables.
English interlaced text and image dataset from ArXiv scientific papers for pre-training.
24.17M image-text pairs from 3.01M open-access English scientific papers.
A 700+ million token corpus for training compact models in step-by-step task analysis and web search.
Multimodal COCO-based dataset with images and English texts for evaluating and training models on fine details.
A synthetic dataset of question-answer pairs based on generated images of documents, tables, and charts.
100K to 1M English image-text question-answer pairs for VLM alignment training.
Short text snippets from English video tutorials with timestamps for search and RAG.