AgentRoboCritic-Muse-Glimmer-30B
A critic for robot actions
2 min readupdated
The model evaluates whether a robot-performed action fulfilled a given local intent based on the task, agent command, and visual observations from multiple cameras. It outputs a structured JSON response containing a verdict, failure category, and explanation derived from what it saw. The model is built on meta-models/Muse-Glimmer-30B (size 29.78 billion parameters) using LoRA (a small add-on to the base model) followed by weight merging. It is useful for researchers and developers in robotics and autonomous agents for analyzing manipulation errors.
Key features
- Analyzes visual observations and task context to evaluate robot actions.
- Returns structured JSON with success fields and failure reasons.
- Trained on 12,844 actions from 12 manipulation benchmarks annotated with GPT-6 Astra.
- Shows accuracy comparable to large closed models on test sets.
What you can do
- Apply in robotic agent evaluation pipelines for automated error detection.
- Use for analyzing failed grasps and classifying manipulation failures.
- Test the model's judgment quality on your own robotics episodes.
Example
import torch
from transformers import AutoModelForImageTextToText, AutoProcessor
checkpoint = "cx-cmu/AgentRoboCritic-Muse-Glimmer-30B"
processor = AutoProcessor.from_pretrained(checkpoint)
critic = AutoModelForImageTextToText.from_pretrained(
checkpoint, dtype=torch.bfloat16, device_map="auto"
).eval()Read more
DetailsBenchmarks (test on 400 actions): overall accuracy 67.75%, outcome accuracy 76.25%, failure mode accuracy 74.24%
Hardware requirements: a machine with sufficient memory to run a 30B model in bfloat16
Training: LoRA (rank 32), 2 epochs, batch 32, learning rate 5×10&sup5; with cosine schedule
License: Apache 2.0 (based on Muse-Glimmer-30B with its own usage policy)








Comments