Skip to content

Dataset · AbedGarra

Fresh Common Crawl news after June 2024

AbedGarra/ccnews2024plus

A large-scale news corpus (10M to 100M texts) for pre-training and fine-tuning language models on current events.

What's inside

Contains news texts from the Common Crawl News archive published after June 2024. The dataset ranges from 10 million to 100 million records and succeeds the well-known stanford-oval/ccnews corpus. Data underwent strict filtering and deduplication using a methodology inspired by the datatrove library.

What you can do with it

  • Pretraining and fine-tuning language models on fresh facts
  • Analyzing geopolitical events and forecasting incidents
  • Training news summarization and classification systems
Size
10M–100M rows
Downloads this month
26.6K
Likes
1

How to load it

from datasets import load_dataset

ds = load_dataset("AbedGarra/ccnews2024plus")