Dataset · ccdv
PubMed article summarization
ccdv/pubmed-summarization
PubMed corpus for summarizing long medical articles: article and abstract.
What's inside
A long-document summarization dataset in English, adapted from an open repository. Contains article text fields and abstract. The source data was pre-tokenized, so the text is assembled via join and split into paragraphs; compatible with the run_summarization.py script from Transformers when mapping is specified.
What you can do with it
- Fine-tune BART or T5 for summarization
- ROUGE evaluation on medical articles
- LoRA for long documents
- Tasks
- Summarization, Text generation
- Languages
- English
- Size
- 100K–1M rows
- Downloads this month
- 4.7K
- Likes
- 100
Models trained on it
- mratsim/MiniMax-M2.5-FP8-INT4-AWQText generation 384
- Stancld/longt5-tglobal-large-16384-pubmed-3k_steps 256
- mratsim/MiniMax-M2.5-BF16-INT4-AWQText generation 82
- mratsim/MiniMax-M2.1-FP8-INT4-AWQText generation 74
- nyamuda/extractive-summarizationSummarization 69
- mratsim/MiniMax-M2.1-BF16-INT4-AWQText generation 25
- lovethayo/MiniMax-M2.5-FP8-INT4-AWQText generation 20
- lxyuan/distilbart-finetuned-summarization 12
How to load it
from datasets import load_dataset
ds = load_dataset("ccdv/pubmed-summarization")