Dataset · opencsg
Chinese Fineweb Edu V2 corpus
opencsg/chinese-fineweb-edu-v2
Large Chinese pre-training corpus; version V2 is marked as deprecated.
What's inside
Chinese Fineweb Edu Dataset V2 is an update to the Chinese Fineweb Edu corpus for educational NLP tasks. These are high-quality Chinese pre-training texts; size ranges from 100 million to 1 billion examples. The version is marked as deprecated, Fineweb-edu-chinese-v2.1 is recommended.
What you can do with it
- Pre-train a Chinese language model
- Fine-tune LoRA on Chinese educational texts
- Filter and prepare pre-training corpus
- Tasks
- Text generation
- Languages
- Chinese
- Size
- 100M–1B rows
- Downloads this month
- 16K
- Likes
- 75
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("opencsg/chinese-fineweb-edu-v2")