cradle-dialogue-qwen3.8-27b-2epoch
mental health crisis detector for dialogues
2 min readupdated
A full fine-tune (updating all model weights) of the 27.36B-parameter Qwen/Qwen3.8-27B language model by SungJoo. Built for turn-by-turn analysis of multi-turn English conversations, it detects whether the user's latest message shows signs of a mental health crisis. Unlike the base Qwen3.8-27B, this checkpoint is trained to output strictly a single line of structured alert and confirmation labels with no extra text, taking both the conversation history and its own prior predictions into account. Useful for clinical NLP researchers and developers testing safety and moderation algorithms for conversational systems.
Key features
- Turn-by-turn classification: analyzes the full dialogue history and previous predictions, assigning labels exclusively to the user's latest message.
- Strict output format: returns a single line — either
noneor one or more semicolon-separated labels (for example,alert_ongoing,confirm_SI_passive_ongoing,confirm_DV_ongoing; confirm_RA_past). - Trained on synthetic data: fine-tuned on the CRADLE-Dialogue dataset, consisting of 3,058 dialogues (48,557 turns) generated from Reddit posts using GPT-5.
- Reasoning block support: uses the Qwen3.8 chat template with the
tag followed by the final classification label.
What you can do
- Research conversational AI safety: use the checkpoint in experiments on early crisis detection across multi-turn chats.
- Compare base model generations: benchmark classification performance against the sibling
cradle-dialogue-qwen3-32b-2epochmodel trained on the same data and hyperparameters. - Automate dialogue labeling: integrate it into
transformers-based research pipelines for turn-by-turn annotation of text sessions.
Example
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_id = "SungJoo/cradle-dialogue-qwen3.8-27b-2epoch"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.bfloat16, device_map="auto", trust_remote_code=True)
# После генерации с chat_template отбрасываем блок размышлений:
label = response.split("")[-1].strip()
Read more
DetailsEpoch 2 checkpoint (step 3208 of 3 epochs) with a maximum context length of 4096 tokens.
Trained in
bfloat16 precision on two NVIDIA H200 GPUs with a 5e-6 learning rate and an effective batch size of 16.Intended strictly for clinical NLP research and does not replace professional help.










Comments