Skip to content

Dataset · SylvanL

Traditional Chinese medicine corpus for pre-training

SylvanL/Traditional-Chinese-Medicine-Dataset-Pretrain

About 1 GB of non-web Chinese medicine texts for continued LLM pre-training.

What's inside

A text corpus with a volume from 100 thousand to 1 million records (about 1 GB) in Chinese (99% Simplified Chinese). Consists of internal materials not taken from the open internet: clinical cases, classical works, medical encyclopedias, and terminology dictionaries. Intended strictly for pre-training or continued pre-training.

What you can do with it

  • Continued pre-training of language models in the Chinese medicine domain
  • Adapting base Chinese LLMs to highly specialized terminology
Tasks
Text generation
Languages
Chinese
Size
100K–1M rows
Downloads this month
607
Likes
36

Models trained on it

How to load it

from datasets import load_dataset

ds = load_dataset("SylvanL/Traditional-Chinese-Medicine-Dataset-Pretrain")