SDAR-TargetSFT-1.7B-b16-ep3
A drafter model for accelerating Qwen3-8B generation
1 min read
This model is built as a drafter (supporting model) for speculative decoding (a method for speeding up token generation in LLMs), partnering with the target model Qwen/Qwen3-8B. It is trained on top of JetLM/SDAR-1.7B-Chat-b16 using the TargetSFT method (block diffusion optimization of SDAR on responses generated by Qwen3-8B). It helps speed up larger language models during text generation. The model will be useful for developers and researchers working on optimizing inference speed (model runtime process) for large language models.
Key features
- Designed for speculative decoding paired with Qwen3-8B
- Based on the 1.7B model
JetLM/SDAR-1.7B-Chat-b16 - Trained on a dataset with response regeneration from Qwen3-8B
- Uses the SDAR block diffusion architecture
What you can do
- Apply the model in a speculative decoding pipeline to accelerate Qwen3-8B inference
- Research multi-step denoising and language model acceleration methods
Example
The model is loaded similarly to the base SDAR model with the parameter trust_remote_code=True, and it shares the tokenizer with Qwen.
Read more
DetailsBase model: JetLM/SDAR-1.7B-Chat-b16
Parameters: 2.03 billion
Training: 5,931 steps on a single RTX PRO 6000 card
Data: 99,032 dialogues from mlabonne/open-perfectblend










Comments