Dataset · open-index
Catalog of RSS feeds for all Hacker News domains
open-index/hacker-news-rss
623,957 discovered RSS/Atom feeds from 1.75M Hacker News websites in parquet format.
What's inside
The authors checked all unique domains ever published on Hacker News over 232 months (from October 2006 to March 2026) and found websites with RSS/Atom feeds. The resulting 623,957 records with expanded metadata are packaged into monthly snapshots in parquet format. The dataset contains tabular data, text, and English images.
What you can do with it
- Training web resource classifiers and thematic aggregators
- Extracting features for recommendation systems and source search
- Analyzing the evolution of web publications and the media landscape over 20 years
- Tasks
- Text classification, Embeddings
- Languages
- English
- Size
- 100K–1M rows
- Downloads this month
- 536
- Likes
- 4
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("open-index/hacker-news-rss")