Skip to content

Dataset · open-index

Catalog of RSS feeds for all Hacker News domains

open-index/hacker-news-rss

623,957 discovered RSS/Atom feeds from 1.75M Hacker News websites in parquet format.

What's inside

The authors checked all unique domains ever published on Hacker News over 232 months (from October 2006 to March 2026) and found websites with RSS/Atom feeds. The resulting 623,957 records with expanded metadata are packaged into monthly snapshots in parquet format. The dataset contains tabular data, text, and English images.

What you can do with it

  • Training web resource classifiers and thematic aggregators
  • Extracting features for recommendation systems and source search
  • Analyzing the evolution of web publications and the media landscape over 20 years
Tasks
Text classification, Embeddings
Languages
English
Size
100K–1M rows
Downloads this month
536
Likes
4

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("open-index/hacker-news-rss")