Dataset · fddemarco
Reddit comments archive (Pushshift)
fddemarco/pushshift-reddit-comments
Massive text and tabular corpus of Reddit user comments for model pre-training.
What's inside
Massive Reddit comment dump containing 1 billion to 10 billion records in text and tabular formats. Detailed descriptions and documentation are absent from the dataset card.
What you can do with it
- Large-scale pre-training of language models on conversational vocabulary
- Training conversational systems and sentiment classification models
- Analyzing social media topics and trends
- Size
- 1B–10B rows
- Downloads this month
- 32.2K
- Likes
- 43
How to load it
from datasets import load_dataset
ds = load_dataset("fddemarco/pushshift-reddit-comments")