Smolder-DeepSeek-R1-Distill-70B
a reasoning model built to prevent hallucinations
2 min readupdated
A 70.55B-parameter large language model by sanyamsood that pairs DeepSeek-R1's step-by-step reasoning with the Smolder Epistemic hallucination-suppression architecture. Designed to generate logically sound answers to complex questions, it refuses to answer rather than fabricate facts when data is missing. Based on deepseek-ai/DeepSeek-R1-Distill-Llama-70B (80 layers, hidden dimension 8192), it's built for developers and researchers who need high factual accuracy when working on complex topics.
Key features
- Smolder Epistemic hallucination-suppression architecture combined with DeepSeek-R1's chain-of-thought reasoning.
- Calibrated abstention: the model refrains from generating an answer when it isn't confident in the facts.
- Strong resistance to misleading questions, scoring 80.0% accuracy on the TruthfulQA MC2 benchmark.
- Open MIT license, letting you freely use and integrate the model weights into your projects.
What you can do
- Integrate it via the
transformerslibrary into local assistants and analytical pipelines to answer complex scientific and technical questions. - Deploy it in workflows where minimizing fabricated facts is critical, relying on its built-in calibrated abstention mechanism.
Example
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "sanyamsood/Smolder-DeepSeek-R1-Distill-70B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.bfloat16, device_map="auto")
inputs = tokenizer("Explain why quantum entanglement does not violate the principle of locality.", return_tensors="pt").to("cuda")
print(tokenizer.decode(model.generate(**inputs, max_new_tokens=512)[0], skip_special_tokens=True))
Read more
DetailsTruthfulQA MC2: 80.0% accuracy on tests with false premises.
OpenAI SimpleQA CGA: 50.0% correct answers among attempted responses (with calibrated abstention).
Architecture: 70.55B parameters, 80 layers, d=8192, primary language English, loads in
bfloat16.









Comments