Skip to content

Dataset · opencsg

Chinese Fineweb Edu V2 corpus

opencsg/chinese-fineweb-edu-v2

Large Chinese pre-training corpus; version V2 is marked as deprecated.

What's inside

Chinese Fineweb Edu Dataset V2 is an update to the Chinese Fineweb Edu corpus for educational NLP tasks. These are high-quality Chinese pre-training texts; size ranges from 100 million to 1 billion examples. The version is marked as deprecated, Fineweb-edu-chinese-v2.1 is recommended.

What you can do with it

  • Pre-train a Chinese language model
  • Fine-tune LoRA on Chinese educational texts
  • Filter and prepare pre-training corpus
Tasks
Text generation
Languages
Chinese
Size
100M–1B rows
Downloads this month
16K
Likes
75

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("opencsg/chinese-fineweb-edu-v2")