Dataset · manu
Project Gutenberg books
manu/project_gutenberg
Over 70k free books in multiple languages for text generation.
What's inside
The dataset is collected from the Project Gutenberg library, featuring over 70k free e-books. Each example corresponds to a single book and contains a service header and footer between the tags *** Start of *** and *** End of ***. Language splits are available, including French, English, Chinese, Portuguese, Polish, and Dutch; data can be streamed.
What you can do with it
- Fine-tuning language models on long literary texts
- Training LoRA for book-style generation
- Evaluating generation quality on literary texts
- Tasks
- Text generation
- Languages
- French, English, Chinese, Portuguese, Polish, Dutch, Russian, Swedish and 3 more
- Size
- 10K–100K rows
- Downloads this month
- 155.2K
- Likes
- 77
Models trained on it
- amd/AMD-Llama-135mText generation 6.8K
- bartowski/YuLan-Mini-GGUFText generation 1.4K
- QuantFactory/AMD-Llama-135m-code-GGUF 1.1K
- nkthebass/tinybrainbot-53m-a9m-hybrid-instructText generation 1K
- QuantFactory/AMD-Llama-135m-GGUF 741
- nkthebass/tinybrainbot-25m-v5.1-baseText generation 732
- mradermacher/AMD-Llama-135m-i1-GGUF 668
- mirth/chonky_mmbert_small_multilingual_1Token classification 635
How to load it
from datasets import load_dataset
ds = load_dataset("manu/project_gutenberg")