PowerRL R1-Distill 1.5B
a math model with adjustable reasoning depth
2 min readupdated
A compact 1.78B-parameter language model built for Olympiad-level math problems with configurable reasoning effort. Based on DeepSeek-R1-Distill-Qwen-1.5B, it was fine-tuned by steviel using reinforcement learning (RL) on the DAPO-Math-17k dataset. Its standout feature is letting you pick one of five effort levels via the system prompt (from minimal Low up to maximum Xhigh), giving you direct control over the trade-off between accuracy and token usage. A solid fit for developers and researchers who need tight control over token budgets when running lightweight reasoning models locally.
Key features
- 5 reasoning levels set via the system prompt: Low, Limited, Mid, High, and Xhigh (four adapted from the ORBIT method, with Limited added specifically for this model).
- Direct speed-vs-accuracy trade-off: at Low, the model uses an average of 723–898 tokens, while High uses around 7,100 tokens and boosts accuracy nearly 2.5x.
- Full merged weights in
bf16format (training step 1500), with the tokenizer and chat template inherited directly from the base model. - Generation context up to 16,384 tokens, outputting final answers in standard
\boxed{}format.
What you can do
- Integrate it into a local Python math-solving or verification service using the
transformerslibrary, switching effort levels based on problem difficulty. - Run inference optimization experiments to find the lowest sufficient reasoning level (such as Limited or Mid) to save compute.
Example
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "steviel/powerrl-r1distill-1.5b-16k-step1500"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")
messages = [
{"role": "system", "content": "You have limited time to think and respond to the user’s query. ..."},
{"role": "user", "content": "Find n <= 100 such that n^2 + 1 is divisible by 5. Let's think step by step and output the final answer within \\boxed{}."},
]
inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
out = model.generate(inputs, max_new_tokens=16384, do_sample=True, temperature=0.6, top_p=0.95)
print(tok.decode(out[0, inputs.shape[1]:], skip_special_tokens=True))
Read more
DetailsAIME 2024 benchmark: 43.0% accuracy at High (7,109 tokens), 35.7% at Mid (4,054 tokens), and 17.9% at Low (898 tokens).
AIME 2025 benchmark: 31.1% at High (7,073 tokens), 27.9% at Mid (3,248 tokens), and 14.9% at Low (723 tokens).
Training: 1,500 steps (128 problems × 16 samples) with an accuracy reward and a length penalty scaled to the chosen effort level.
Limitations: trained and evaluated exclusively on English-language Olympiad math; responses over 12,000 tokens are accurate only 9% of the time (compared to 89% for responses under 4,000 tokens).










Comments