Dataset · SylvanL
Traditional Chinese medicine corpus for pre-training
SylvanL/Traditional-Chinese-Medicine-Dataset-Pretrain
About 1 GB of non-web Chinese medicine texts for continued LLM pre-training.
What's inside
A text corpus with a volume from 100 thousand to 1 million records (about 1 GB) in Chinese (99% Simplified Chinese). Consists of internal materials not taken from the open internet: clinical cases, classical works, medical encyclopedias, and terminology dictionaries. Intended strictly for pre-training or continued pre-training.
What you can do with it
- Continued pre-training of language models in the Chinese medicine domain
- Adapting base Chinese LLMs to highly specialized terminology
- Tasks
- Text generation
- Languages
- Chinese
- Size
- 100K–1M rows
- Downloads this month
- 607
- Likes
- 36
Models trained on it
How to load it
from datasets import load_dataset
ds = load_dataset("SylvanL/Traditional-Chinese-Medicine-Dataset-Pretrain")