Dataset · gaia-benchmark
GAIA Benchmark for Agentic LLMs
gaia-benchmark/GAIA
450+ non-trivial questions with single-answer targets for testing tool-using and search-equipped LLMs.
What's inside
GAIA is a benchmark for evaluating next-generation LLMs with access to tools, search, and autonomous actions. It features over 450 non-trivial questions with single-answer targets requiring varying levels of tool use and autonomy. Data includes audio, documents, images, and text in English; access is restricted for anti-scraping protection.
What you can do with it
- Evaluating agentic LLMs with tools
- Testing multimodal QA
- Comparing models on the GAIA leaderboard
- Languages
- English
- Size
- up to 1K rows
- Downloads this month
- 26.9K
- Likes
- 999
- Access
- on request on Hugging Face
Models trained on it
- MLBenyamin/gpt2-gaia-lora-adapterText generation 23
- jimjonesbabyfreshout/JefeHuggingface 0
- Prosoft82/Ahkam12 0
- andresproc/whisperText classification 0
- nurcan/nurrcan 0
- ChromaFlow9897/chromaflow-gaia-benchmark 0
- Santhoshwar2204/q3ewrtyhTable question answering 0
- MLBenyamin/Qwen3-0.6B-mlp-layer-EX-gaia-lora-adapter 0
How to load it
from datasets import load_dataset
ds = load_dataset("gaia-benchmark/GAIA")