GLUE benchmark for language understanding
Collection of tasks and data for training and evaluating English text understanding systems.
- Text classification
- English
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
Collection of tasks and data for training and evaluating English text understanding systems.
Large-scale multilingual archive of news articles from 2016–2026 with quality filtering and deduplication.
Large English web corpus broken down by dozens of domains and iteration statistics for training and classification.
Large-scale English corpus of 1.61 million web novel records containing text, tables, and images.
Challenging NLU tasks including textual entailment, QA, and coreference resolution for language model evaluation.
50k labeled movie reviews for binary sentiment classification in English.
Over a million news articles from 2,000+ sources with topic labeling for text classification.
All Hacker News stories, comments, Ask HN, Show HN, jobs, and polls in English.
Tabular and text dataset of human gene expression profiles during respiratory viral immunization.
A large dataset from Amazon with query-product pairs and relevance judgments in three languages to improve search.
Large array of anonymized purchases, customer profiles, and H&M clothing metadata for recommendation systems.
15,942 natural yes/no questions based on an English text snippet.
Corpus of 145K machine learning research paper texts from PDF files.
5,331 positive and 5,331 negative sentences from Rotten Tomatoes reviews for sentiment classification.
13,948 multiple-choice questions across 52 disciplines for evaluating Chinese foundation models.
An English test set to evaluate how LLMs handle complex long-context tasks.
Massive, regularly updated scrape of public videos, comments, and stats from the Chinese platform Bilibili.
MRC benchmark with questions and 4-way multiple-choice options across 122 language varieties, including low-resource ones.
Hundreds of millions of public Bluesky posts and user relationship links since November 2022 for social network analysis and model training.
Over 760K English sentence pairs with similar words but different meanings to test context understanding.
Regularly updated corpus of posts, comments, photos, videos, and profiles from VK in Russian and Ukrainian.
Mathematical reasoning benchmark over images: IQTest, FunctionQA, and PaperQA; languages en, zh, fa.
11,855 movie review sentences with sentiment labels for classification and composition analysis.
67 thousand English minimal sentence pairs for testing grammar knowledge in language models.