Qwen3.8-27B-hermes-adapted-MLX-adapter
A LoRA adapter for programming tasks on Apple Silicon
2 min readupdated
This LoRA adapter (a small plugin built on top of a base model) ports the model from harness-hub into the mlx-lm library format so it can run on Apple Silicon devices. The model was trained using reinforcement learning (RL) to operate within the Hermes Agent for software engineering and terminal tasks. It handles coding and terminal commands much more efficiently, using fewer tokens and steps. The adapter is useful for developers and Mac users who want to run powerful local agents for writing code.
Key features
- Specialization in software engineering and terminal tasks
- Optimization for the mlx-lm framework on Mac
- Improved metrics on SWE-bench Pro and Terminal-Bench tasks
- Reduced token generation compared to the base model
What you can do
- Apply it in Hermes Agent to automate engineering tasks
- Run it via the mlx_lm.server command line for local development
- Integrate it into Python scripts using mlx_lm
- Use the adapter on top of quantized versions of the model on Mac
Example
from huggingface_hub import snapshot_download
from mlx_lm import load, generate
adapter = snapshot_download("netprojects/Qwen3.8-27B-hermes-adapted-MLX-adapter")
model, tokenizer = load("mlx-community/Qwen3.8-27B-4bit", adapter_path=adapter)
prompt = tokenizer.apply_chat_template([{"role": "user", "content": "Hello"}], add_generation_prompt=True,
enable_thinking=False, tokenize=False)
print(generate(model, tokenizer, prompt=prompt, max_tokens=200))Read more
Details• SWE-bench Pro (hard 51): 29.4% → 43.1%
• Terminal-Bench 2.1: 44.7% → 58.8%
• Adapter size: 638 MB
• License: Apache-2.0










Comments