Gemma 4 31B-it Thinkless R2: Speeding up responses through weight arithmetic
2 min readupdated
A modification of the base google/gemma-4-31B-it model created through direct weight manipulation without additional training. In this version, the output layer is separated from the input embeddings (tie_word_embeddings: false), and a special vector is added to the end-of-thinking token, which reduces excessive model reasoning. This approach cuts down the number of generated tokens and speeds up response retrieval while maintaining accuracy on question-answering tasks. The model is suitable for researchers and developers who value fast large language model (LLM) performance without lengthy thinking generation phases.
Key features
- Built on
google/gemma-4-31B-itwithout a retraining stage. - Output layer weights modified and a vector added to the end-of-thinking token.
- Reduces tokens per correct answer to 0.638x at zero temperature.
What you can do
- Use for efficient question-answering systems where fast results are required.
- Run via the vLLM engine to test optimized text generation.
Example
Example prompt for the model: "Explain the basic principles of thermodynamics in simple terms." The model produces a correct answer faster and with fewer intermediate "thoughts" than the standard Gemma 4 version with full reasoning enabled.
Read more
DetailsBenchmarks at temperature 0: tokens per correct answer — 0.638x, accuracy — +0.05 points.
Limitations: accuracy drops in multi-step tool calling (BFCL v4) and in LiveCodeBench.
Hardware requirements: running in FP8 on load (for example, on an NVIDIA B200 GPU via the vLLM engine).










Comments