ToolCall-200M-DPO
Experimental Language Model for Function Calling
1 min read
This model is a checkpoint fine-tuned with DPO (Direct Preference Optimization) to improve format adherence. The base 200M model was trained from scratch on 4 billion tokens using free Kaggle sessions. Experiments show that format optimization reduces hanging and improves refusals for irrelevant queries, though tool selection accuracy drops slightly.
Key features
- DPO optimization: Focused on strict adherence to structured output formats.
- Improved refusals: The model makes fewer errors on irrelevant prompts and hits token limits less often.
- Compact size: Only 200 million parameters for lightweight local tasks.
- Accuracy limitations: Tool and argument selection accuracy is lower compared to the base version.
What you can do
- Test responses: Evaluate the model's function calling behavior compared to the SFTv4 version.
- Pipeline integration: Use it to study how small language models behave under format constraints.
For general use, developers recommend the base SFTv4 version, while this checkpoint is interesting for studying the impact of DPO on tool-calling accuracy.
Read more
DetailsContext: 2,048 tokens
Tool selection accuracy: 66.87% (vs. 72.80% for base)
Exact calls: 21.73% (vs. 23.71% for base)
Correct refusals: 69.17% (vs. 65.42% for base)










Comments