Multilingual sentence pairs for paraphrase detection
Over 320,000 sentence pairs across six languages for testing and training models in semantic understanding.
- Text classification
- German
- English
- Spanish
- +4
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
Over 320,000 sentence pairs across six languages for testing and training models in semantic understanding.
English biographies with profession and gender labels for studying biases in NLP models.
Cartoons and captions from the New Yorker contest for evaluating humor understanding in models.
11 datasets for fact-checking, QA, entity linking, and dialogue on a single Wikipedia dump.
2.7 million US wire service articles from 1878-1977 with geolocation, topics, and entities.
LLM prompts labeled as jailbreak or benign to train harmful request detectors.
A corpus of human and ChatGPT answers for comparison and text detection.
Preprocessed English dataset for language model alignment using DPO.
A large corpus of alt-text and image pairs from HTML for training multimodal models.
Demographic and psychological data from a representative sample of people for character simulation using LLMs.
Generated texts from various domains with PII and PHI entity annotations for training anonymization models.
8 Korean NLU tasks for evaluating language models: from NER and NLI to MRC and DST.
A collection of personas for generating diverse synthetic texts and instructions.
From 10,000 to 100,000 English scientific tasks for comprehensive LLM knowledge evaluation.
From 1 to 10 million annotated texts in six European languages for the NER task, collected using BabelNet and BERT.
A subset of MS MARCO in the BEIR benchmark format of millions of English documents and search queries.
Participant audio, video, and texts in English and Chinese with clinically confirmed diagnoses for distinguishing disorders.
Large Chinese dataset (1M to 10M) for search, recommendations, and RAG systems.
A set of English tweets from a Kaggle competition for evaluating and training text embeddings in the sentiment analysis task.
A collection of eval tasks generated by LLMs to test model behavior.
Texts with personally identifiable information in English, French, German, and Italian for privacy masking training.
A large-scale collection of diverse Arabic texts from various sources for a wide range of NLP tasks.
300k texts across 6 languages with PII annotations for training data removal models.
A set of English prompts and responses generated via ChatGPT to evaluate model vulnerabilities and alignment.