Qwen3-0.6B-Game-Decision-Model
a compact AI for decision-making across 23 games
3 min readupdated
A specialized language model from kaushik-harsh-99, fine-tuned to choose optimal moves across 23 board, card, strategy, and puzzle games. Built on the lightweight Qwen3-0.6B architecture (0.6B parameters), it merges LoRA adapters (small add-on layers on top of a base model) and an Unsloth FastDecisionModel / CLEF classification head into unified 16-bit weights. Decision accuracy jumped from 28.04% on the un-tuned base model to 67.81%, all in a package just over a gigabyte that runs even on low-end GPUs. It is built for developers of game bots, simulations, and agents who need fast action selection from text-based game state descriptions.
Key features
- Trained on 1,092,754 game states from the
boardgame-decision-modelsdataset spanning 23 games — from chess and poker to Minesweeper, 2048, and Mastermind. - +39.77% accuracy boost: averages 67.81% on a 2,193-sample benchmark, hitting near-perfect scores on individual titles — 100% in Mastermind, 98% in blackjack, and 96% in Yahtzee.
- Ready-to-use merged weights: shipped as
model.safetensors(1.14 GB + 52 MB classification head), so there is no need to manually merge adapters before running inference. - Low memory footprint: supports 4-bit quantization (weight compression to save memory) via Unsloth, fitting in under 2 GB of VRAM.
What you can do
- Build a game bot or sparring partner: plug the model in via the ready-made
GameDecisionRunnerclass to generate moves and score action probabilities in blackjack, Connect Four, 2048, or Dots and Boxes. - Add an action-selection module to an LLM agent: pass the current environment state and available choices to quickly get the best next move along with a confidence score.
- Test it in the terminal: run the included
test_inference.pyscript in interactive mode to test the model's logic on your own game scenarios.
Example
from runner import GameDecisionRunner
runner = GameDecisionRunner.from_pretrained("kaushik-harsh-99/Qwen3-0.6B-Game-Decision-Model")
result = runner.predict(
game="blackjack",
state="Dealer shows 7. Player hand: [10 of Clubs, 6 of Hearts] (Hard 16).",
choices=["Hit", "Stand", "Double Down", "Surrender"],
instructions="Select optimal blackjack basic strategy action."
)
print(result["best_action"], f"{result['confidence']:.1%}")Read more
DetailsBenchmark (2,193 samples): overall accuracy is 67.81% vs. 28.04% for the base Qwen3-0.6B, with cross-entropy dropping from 1.5026 to 0.7298; the biggest jump is in Dots and Boxes (88% vs. 3%).
Hardware & memory: FP16 weights take 1.19 GB, and 4-bit mode uses under 2 GB VRAM; training took 70.3 hours on a single NVIDIA RTX 3050 (6 GB).
Training setup: 34,149 steps with the AdamW optimizer, 1,024-token context length, LoRA rank 16 and alpha 32.
Limitations: accuracy drops in complex strategy games requiring deep lookahead (chess — 29.2%, checkers — 35.0%, solitaire — 23.0%).










Comments