Multilingual Aya collection for NLP tasks
A large multilingual collection of texts for classification, summarization, and translation.
- Text classification
- Summarization
- Translation
- Acehnese
- Afrikaans
- Amharic
- +9
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
A large multilingual collection of texts for classification, summarization, and translation.
A high-quality Chinese instruction dataset for SFT sourced from web Q&A and articles.
An extension of the FineWeb-2 dataset with community-scored educational quality ratings.
A collection of augmented FLAN data aligned with the Orca distribution for instruction tuning.
Large English corpus of 1-10 million texts from the Yahoo Answers portal for topic classification tasks.
55k real dialogues and preference evaluations between 70+ LLMs in pairwise battles.
Text collection annotated with harmful and safe prompts and responses for LLM safety research.
Multi-phase abdominal CT scans with lab panels, reports, organ masks, and tumor masks.
An English dataset (up to 1K examples) for testing agent long-term memory.
Labeled cybersecurity event dataset from a production SOC: attacks and normal traffic on a shared timeline.
Cleaned set of ~25k Python instructions with input/output for training and evaluating code models.
English assistant dialogues about software vulnerabilities, CVEs, CWEs, patches, and web appsec.
10K prompts from Vicuna demo with toxicity annotations for classification.
Nearly 728 hours of Khmer audio recordings with manual transcription for speech recognition.
39,565 English comments with ratings from 7,912 annotators across 10 toxicity and hate speech scales.
Corpus of English biomedical texts and queries for evaluating information retrieval systems.
A set of 5,574 real English SMS messages labeled as spam or ham for text classification tasks.
Large-scale corpus of image-text pairs where caption phrases are grounded to corresponding image regions.
A massive multilingual corpus of 600 million news articles from 2016 to June 2024.
English financial tweets annotated with bearish, bullish, and neutral sentiment.
17,000 English sentences to measure gender, racial, religious, and occupational stereotypes in LLMs.
100k English records annotated with 55+ PII/PHI categories for training personal data detection.
Text and tabular tasks for training and evaluating Chinese language understanding models.
Over 320,000 sentence pairs across six languages for testing and training models in semantic understanding.