Skip to content

Dataset · fddemarco

Reddit comments archive (Pushshift)

fddemarco/pushshift-reddit-comments

Massive text and tabular corpus of Reddit user comments for model pre-training.

What's inside

Massive Reddit comment dump containing 1 billion to 10 billion records in text and tabular formats. Detailed descriptions and documentation are absent from the dataset card.

What you can do with it

  • Large-scale pre-training of language models on conversational vocabulary
  • Training conversational systems and sentiment classification models
  • Analyzing social media topics and trends
Size
1B–10B rows
Downloads this month
32.2K
Likes
43

How to load it

from datasets import load_dataset

ds = load_dataset("fddemarco/pushshift-reddit-comments")