Dataset · AbedGarra
Fresh Common Crawl news after June 2024
AbedGarra/ccnews2024plus
A large-scale news corpus (10M to 100M texts) for pre-training and fine-tuning language models on current events.
What's inside
Contains news texts from the Common Crawl News archive published after June 2024. The dataset ranges from 10 million to 100 million records and succeeds the well-known stanford-oval/ccnews corpus. Data underwent strict filtering and deduplication using a methodology inspired by the datatrove library.
What you can do with it
- Pretraining and fine-tuning language models on fresh facts
- Analyzing geopolitical events and forecasting incidents
- Training news summarization and classification systems
- Size
- 10M–100M rows
- Downloads this month
- 26.6K
- Likes
- 1
How to load it
from datasets import load_dataset
ds = load_dataset("AbedGarra/ccnews2024plus")