TCM-Qwen3.5-9B-Instruct-CPT-1029
a model for medical text analysis
2 min readupdated
This is a specialized version of Qwen/Qwen3.5-9B, fine-tuned via continuous pre-training (CPT) on medical texts, textbooks, and patient records. It merges the base architecture weights with a language LoRA adapter while preserving chat capabilities. Built for research in medical text processing and assisting with specialized literature analysis, the model is not intended for autonomous diagnosis or prescribing treatment without medical professionals.
Key features
- Medical domain adaptation: Trained on a dataset of medical books, clinical knowledge, and case histories.
- Lower PPL: Perplexity (a measure of text uncertainty) on medical data dropped by over 33%.
- Benchmark gains: Shows improved scores across several tasks, including the C-Eval exam benchmark.
- Merged weights: The adapter is already merged into the base model, making it easy to run without extra libraries.
What you can do
- Literature review: Summarize and extract information from specialized medical sources.
- Chatbot integration: Set up a local assistant to answer questions on medical theory.
- Output comparison: Compare how it generates medical terminology against the base Qwen model.
- Text processing: Extract entities from medical reports and clinical notes.
Example
from transformers import AutoModelForImageTextToText, AutoProcessor
model_id = "Xxiao2023/TCM-Qwen3.5-9B-Instruct-CPT-1029"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForImageTextToText.from_pretrained(model_id, device_map="auto")
Read more
DetailsBased on Qwen/Qwen3.5-9B with 9.41B parameters.
Benchmark results: C-Eval rose from 61.44% to 65.53%, HellaSwag reached 70.86%.
Trained on a single NVIDIA RTX A6000 (48GB).
Requires a compatible environment with Hugging Face Transformers 5.17.0 and PyTorch.










Comments