Multimodal Chart Dataset
A large-scale multimodal chart corpus with images and text for data extraction, VQA, and multilingual understanding.
- Image → text
- Visual question answering
- Table question answering
- English
- Arabic
- Chinese
- +9
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
A large-scale multimodal chart corpus with images and text for data extraction, VQA, and multilingual understanding.
22M image-text-to-text instructions for training and fine-tuning large multimodal models.
Nearly 70,000 English and Chinese examples for training educational LLMs and VLMs.
A curated collection of 59 English datasets for training VLMs in logic, STEM, charts, and OCR.
A dynamic English-language benchmark for assessing how well multimodal LLMs understand scientific journals and illustrations.
A set of under 1,000 complex multimodal questions with images for testing the limits of modern models.
Generated pages in Vietnamese and English with block annotations for training document parsing.
A large-scale multimodal benchmark for evaluating action understanding in video.
Multimodal dataset from Amazon Science to test VLM capability to find answers in bulky documents and images.
English and Chinese documents and tables for testing slide generation.
Mathematical reasoning benchmark over images: IQTest, FunctionQA, and PaperQA; languages en, zh, fa.
A multilingual collection of Wikimedia vector diagrams and maps with text coordinate annotations for evaluating image translation.
Millions of short daily first-person videos with detailed captions and Q&A from Reka AI.
Large-scale architecture photo base with metadata to train multimodal models in guessing the construction year.
An English video corpus for training models to answer questions about videos.
English prompt dataset with image pairs for evaluating text-to-image preferences.
Multidisciplinary visual and textual questions for multimodal understanding evaluation.
A set of 4,000 video questions across 20 tasks to test time and action perception by multimodal models.
Large Conceptual Captions 12M dataset in WebDataset format for pre-training multimodal models.
A large open collection of English image-text pairs for high-quality text-to-image fine-tuning.
About 400k English video clips with detailed scene, shot, and camera motion descriptions.
Manga illustrations and English/Japanese texts for classification and VQA.
31k hours of image-prompted spontaneous speech across 105 Indian languages, with transcripts for ASR and multimodal tasks.
English pairs of images, questions, and answers gathered from arXiv research publications.