Skip to content

Dataset · botp

711k Japanese web novels from Syosetuka ni Narou

botp/RyokoAI_Syosetu711K

Large fiction text corpus in Japanese for generation and classification.

What's inside

The dataset contains about 711,700 novels and stories in Japanese scraped from the popular self-publishing platform Syosetuka ni Narou in late March 2023. The dump includes most works published on the site at the time of collection. The card authors note that the BigKnow2022 project is not yet finished, so some metadata may be inaccurate.

What you can do with it

  • Pretraining and fine-tuning generative language models on Japanese fiction
  • Training genre and style classifiers for Japanese web literature
Tasks
Text classification, Text generation
Languages
Japanese
Size
100K–1M rows
Downloads this month
1.7K
Likes
36

How to load it

from datasets import load_dataset

ds = load_dataset("botp/RyokoAI_Syosetu711K")