Dataset · Helsinki-NLP
OPUS parallel books for translation
Helsinki-NLP/opus_books
Aligned books in multiple languages for training and evaluating translation models.
What's inside
This is a collection of copyright-free books aligned by András Farkas and available at farkastranslations.com. Texts are in Catalan, German, Greek, English, Esperanto, and Spanish; part of it is manually verified, and metadata is stored in XML at the beginning of the files. Due to copyright, the texts are quite old, but the source is multilingually aligned.
What you can do with it
- Train a machine translation model on parallel books
- Fine-tune LoRA for translation between European languages
- Evaluate translation quality on literary texts
- Tasks
- Translation
- Languages
- Catalan, German, Greek, English, Esperanto, Spanish, Finnish, French and 4 more
- Size
- 1M–10M rows
- Downloads this month
- 9K
- Likes
- 102
Models trained on it
- anonymus16/t5-small-hungarian-translatorTranslation 100
- evilfreelancer/enbeddrus-v0.2Embeddings 39
- evilfreelancer/enbeddrus-v0.1Embeddings 37
- evilfreelancer/enbeddrus-v0.1-domainEmbeddings 34
- ashaduzzaman/t5-small-finetuned-billsumSummarization 32
- kyLELEng/t5-small-multitask-text2textQuestion answering 32
- Amirhossein75/Sequence2Sequence-Transformer-Translation-Opus-MTTranslation 22
- ashaduzzaman/t5-small-finetuned-opus-booksTranslation 18
How to load it
from datasets import load_dataset
ds = load_dataset("Helsinki-NLP/opus_books")