Skip to content

Dataset · ccdv

PubMed article summarization

ccdv/pubmed-summarization

PubMed corpus for summarizing long medical articles: article and abstract.

What's inside

A long-document summarization dataset in English, adapted from an open repository. Contains article text fields and abstract. The source data was pre-tokenized, so the text is assembled via join and split into paragraphs; compatible with the run_summarization.py script from Transformers when mapping is specified.

What you can do with it

  • Fine-tune BART or T5 for summarization
  • ROUGE evaluation on medical articles
  • LoRA for long documents
Tasks
Summarization, Text generation
Languages
English
Size
100K–1M rows
Downloads this month
4.7K
Likes
100

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("ccdv/pubmed-summarization")