Skip to content

Dataset · HuggingFaceGECLM

Comments from 50 popular Reddit subreddits

HuggingFaceGECLM/REDDIT_comments

A massive corpus of English Reddit comments (2006-2023) for training language and dialogue models.

What's inside

It compiles English text comments from 50 selected subreddits, including tifu and explainlikeimfive. The total volume ranges from 100 million to 1 billion records, partitioned by specific communities. Data is extracted from REDDIT PushShift archives for the period from 2006 to January 2023.

What you can do with it

  • Pre-training or fine-tuning English language models
  • Training dialogue systems and generative bots on natural speech
  • Text classification by thematic communities
Tasks
Text generation
Languages
English
Size
100M–1B rows
Downloads this month
13.8K
Likes
48

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("HuggingFaceGECLM/REDDIT_comments")