VML (Visual ML) v2.0.0
Offline Mobile Legends Asset Recognition
2 min readupdated
VML (Visual ML) is a fully offline computer vision model for recognizing visual assets from Mobile Legends: Bang Bang (MLBB). It takes a 224×224 pixel image as input and simultaneously outputs a vector representation (embedding) while classifying the object across two levels of detail, from broad categories down to specific skins or items. Built on the lightweight ConvNeXt-Tiny architecture, the model was distilled (compressed during training without major accuracy loss) from a heavier vit_base_patch16_siglip_224 teacher model by sansaks. Unlike standard classifiers, the release ships with a prebuilt reference vector database for fast similarity search, making it well-suited for analyzing live streams and tournament broadcasts.
Key features
- Two-level classification: identifies 282 coarse categories (heroes, items, spells, emblems, talents, skills, UI) and 2,794 fine-grained classes, including individual skins across 134 heroes.
- Built-in database search: ships alongside 4,677 precomputed 768-dimensional normalized embeddings (
hero_skin_db.npz) and JSON label-mapping files. - ONNX format and offline execution:
hero_skin_student.onnxrequires no internet connection and runs smoothly via standard ONNX Runtime. - Resilient to broadcast artifacts: tested on synthetic tournament frames featuring OBS blur, JPEG compression, overlapping in-game name (IGN) text, and circular icon crops.
What you can do
- Build a stream overlay or analytics parser to automatically track picks, bans, item builds, and selected skins directly from MLBB live streams and tournament VODs.
- Add visual similarity search (via 768-dimensional embeddings) to fan databases, wikis, or Telegram bots to identify in-game elements from cropped screenshots.
Example
The model accepts a pixel_values tensor of shape [B, 3, 224, 224] and returns three outputs: embedding (a [B, 768] vector for querying hero_skin_db.npz), coarse_logits ([B, 282] for the base category, such as Skill | ), and fine_logits ([B, 2794] for the exact class, such as | skin_XX).
Read more
DetailsStress-test accuracy (200 synthetic tournament broadcast frames): Coarse Top-1 — 99.0%, Fine Top-1 — 93.0%, 768-d DB Retrieval Top-1 — 99.5% and Top-5 — 100.0%.
Training dataset: 4,677 standardized PNG assets (134 heroes, icons, portraits, skins, skills, items, spells, emblems, talents, and UI elements).
Included files:
hero_skin_student.onnx, hero_skin_student.onnx.data, the hero_skin_db.npz vector database, and JSON label dictionaries.







Comments