Skip to content

Dataset · lmms-lab

Video question-answering dataset for video-LLM training

lmms-lab/LLaVA-Video-178K

Video and text pairs for training and evaluating video question-answering models.

What's inside

The dataset contains video and English text data for visual question-answering and video-text-to-text tasks. The card specifies 178,510 caption records; the collection was compiled from five main video-language data sources and was used to train LLaVA-Video. Permitted for academic research and education only.

What you can do with it

  • Training LLaVA-Video and similar video-LLMs
  • Evaluating models on video question answering
  • Video-text-to-text research
Tasks
Visual question answering, Video text → text
Languages
English
Size
1M–10M rows
Downloads this month
106.1K
Likes
215

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("lmms-lab/LLaVA-Video-178K")