Dataset · HuggingFaceGECLM
Comments from 50 popular Reddit subreddits
HuggingFaceGECLM/REDDIT_comments
A massive corpus of English Reddit comments (2006-2023) for training language and dialogue models.
What's inside
It compiles English text comments from 50 selected subreddits, including tifu and explainlikeimfive. The total volume ranges from 100 million to 1 billion records, partitioned by specific communities. Data is extracted from REDDIT PushShift archives for the period from 2006 to January 2023.
What you can do with it
- Pre-training or fine-tuning English language models
- Training dialogue systems and generative bots on natural speech
- Text classification by thematic communities
- Tasks
- Text generation
- Languages
- English
- Size
- 100M–1B rows
- Downloads this month
- 13.8K
- Likes
- 48
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("HuggingFaceGECLM/REDDIT_comments")