Robotics, RL, and VQA training dataset
An English dataset of 10K–100K examples featuring scene descriptions, trajectories, and VQA tasks for embodied AI.
- Visual question answering
- Reinforcement learning
- Robotics
- English
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
An English dataset of 10K–100K examples featuring scene descriptions, trajectories, and VQA tasks for embodied AI.
A dataset of annotated CCTV clips for evaluating VLMs in industrial safety.
English chart-question pairs to evaluate whether VLMs actually analyze images instead of guessing.
10k to 100k digitized multi-page National Archives documents in English.
Large DataComp-1B image-text corpus with improved captions from LLaVA-1.5-LLaMA3-8B.
A benchmark evaluating video models on real-time video question answering (CVPR 2025).
Large-scale benchmark for comparative summarization of chart pairs by language models.
Instructional dataset for educational tasks and multimodal learning.
A slice of the ultra-large MINT-1T dataset of 1M to 10M records with interleaved English text and images.
A set of 1,060 questions and reference answers in English across 171 business documents in various formats.
Question-answer pairs on pathology images for training and evaluating medical VQA systems.
An English video-text instruction dataset for training models to understand long videos.
14,935 unique CAD tasks with images and three expert answers each.
Complex Olympiad-level problems with images in English and Chinese for evaluating model scientific reasoning.
Metadata and scripts for downloading bird images for visual question-answering tasks.
Multimodal dataset of 159,549 question-answer pairs for benchmarking in gastrointestinal endoscopy.
Multimodal evaluation dataset and MME benchmark from the MixLoRA paper (ACL 2024).
Part of the giant open MINT-1T dataset featuring interleaved English text and PDF images.
Tens of millions of text image and transcript pairs for training Telugu optical character recognition systems.
A collection of Chinese technical tables and blueprint images for evaluating Multimodal Large Language Models (MLLMs).
A collection of videos and questions in English for evaluating scene event understanding by multimodal LLMs.
Large dataset for text-based event retrieval in video clips up to 100 minutes long.
Image-text pairs for training multimodal models to detect image editing artifacts.
Part of a giant open dataset with interleaved texts and images from PDFs and the web.