Skip to content

Dataset · lmms-lab

M4 multi-image instruction sets

lmms-lab/M4-Instruct-Data

Multi-image instruction datasets for training multimodal models.

What's inside

M4-Instruct is a multi-image dataset collected from public datasets or generated via the GPT-4V API. It is designed to train LMMs to work with interleaved multiple images, such as LLaVA-NeXT-Interleave. Language is English, size is from 100k to 1M examples; collected in April 2024 and released in June 2024. Tasks are visual-question-answering and question-answering.

What you can do with it

  • Train LMMs on multi-image instructions
  • Fine-tune LLaVA-NeXT-Interleave-like models
  • Verify answers across multiple images
Tasks
Visual question answering, Question answering
Languages
English
Size
100K–1M rows
Downloads this month
4.9K
Likes
78

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("lmms-lab/M4-Instruct-Data")