Synthetic corpus in 22 Indian languages from NVIDIA
Huge text corpus of 1 to 10 billion records in 22 Indian languages for language model pre-training.
- Text generation
- Assamese
- Bangla
- Bodo
- +9
Hugging Face datasets with plain-language descriptions: what's inside and what models to train on them. 4,788 in the catalog so far, with new ones added every hour.
Answered by Gemini 4 · the chat is kept only in this tab
Huge text corpus of 1 to 10 billion records in 22 Indian languages for language model pre-training.
About 4,000 verified examples of generating Three.js 3D models with reasoning and renders.
NVIDIA's updated pre-training corpus with code, math, English web text, and synthetics.
Raw anonymized traces of the Claude Fable 5 agent for training and analyzing agent scenarios.
Over 142 thousand live chats with ChatGPT, Claude, Gemini, Grok, and Perplexity for chatbot training and prompt analysis.
Large Chinese dataset (1M to 10M) for search, recommendations, and RAG systems.
Code-to-text documentation pairs from CodeSearchNet for training description generation.
Three reading comprehension question sets created to identify weaknesses in language models.
A large set of medical tasks with step-by-step reasoning for explainable LLM answers.
Large English and Japanese code corpus for training and fine-tuning language models.
Synthetic medical dialogues with reasoning chains for SFT of LLMs in healthcare.
Original CodeAlpaca split into train and test; about 20k text examples for code generation.
A collection of eval tasks generated by LLMs to test model behavior.
254k cleaned Chinese Wikipedia articles for training generative models in Chinese.
6.5k visual math problems with hierarchical knowledge annotation for evaluating VLM reasoning.
OpenAI collection of short factual English questions for evaluating LLM truthfulness.
A large open speech dataset across 25 European languages for ASR and speech translation.
Clean sectioned corpus in Arabic and English for pre-training a small LLM.
Large corpus of synthetic texts on code, logic, and economics for LLM pre-training.
5000 multi-step agent trajectories for training and evaluating agent models in English.
110k Chinese examples with R1 answers gathered in the output field for SFT training.
PubMed corpus for summarizing long medical articles: article and abstract.
Texts with personally identifiable information in English, French, German, and Italian for privacy masking training.
803 prompts in English to test models for factualness and a bias toward official PRC propaganda.