Google engineering task benchmark
A set of complex multi-step tasks from licensed engineers for evaluating AI agents.
- Text generation
- Question answering
- English
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
A set of complex multi-step tasks from licensed engineers for evaluating AI agents.
Multimodal dataset from Amazon Science to test VLM capability to find answers in bulky documents and images.
English and Chinese documents and tables for testing slide generation.
Collection of open scientific texts and metadata from arXiv, CVF, NeurIPS, and other venues.
Q&A based on historical US Treasury bulletins to evaluate AI agents' ability to analyze tables, charts, and text.
Dataset for evaluating models and agents on US Federal report documents.
LHTB evaluates how LLM agents maintain useful work in a containerized terminal over hundreds of steps.
A set of 1,060 questions and reference answers in English across 171 business documents in various formats.
Cleaned and chunked documents from Brazilian regulator CVM in Portuguese for language model fine-tuning.
600 questions across various knowledge domains to evaluate factual accuracy and LLM hallucination tendency.
English benchmark for evaluating spatial sound understanding and multi-hop reasoning.
17.6K published math problems of varying difficulty for testing reasoning models.
A 700+ million token corpus for training compact models in step-by-step task analysis and web search.
160k synthetic and 200k augmented examples of user, assistant, and tool interactions.
Test tasks for evaluating autonomous agents in healthcare scenarios: from treatment authorization to patient management.
A curated selection of English books on AI, ML, DL, RL, transformers, and LLMs for structured study.
Synthetic business PDFs and nearly 10,000 questions on tables, charts, forms, and text for evaluating Document QA systems.
A collection of research papers, code, chats, and traces from autonomous scientific agents on a preprint server.
Around 1,500 Chinese-translated light novels in text format and PDFs with illustrations for creative text generation.
Testing whether LLMs know what they do not know and can correct their mistakes.
English evaluation set for testing how language models respond to users' emotional requests.