Dataset · botp
711k Japanese web novels from Syosetuka ni Narou
botp/RyokoAI_Syosetu711K
Large fiction text corpus in Japanese for generation and classification.
What's inside
The dataset contains about 711,700 novels and stories in Japanese scraped from the popular self-publishing platform Syosetuka ni Narou in late March 2023. The dump includes most works published on the site at the time of collection. The card authors note that the BigKnow2022 project is not yet finished, so some metadata may be inaccurate.
What you can do with it
- Pretraining and fine-tuning generative language models on Japanese fiction
- Training genre and style classifiers for Japanese web literature
- Tasks
- Text classification, Text generation
- Languages
- Japanese
- Size
- 100K–1M rows
- Downloads this month
- 1.7K
- Likes
- 36
How to load it
from datasets import load_dataset
ds = load_dataset("botp/RyokoAI_Syosetu711K")