WVY-3D-1M
An ultra-lightweight AI model for auto-rigging and 3D creature animation
2 min readupdated
The WVY-3D-1M model consists of just 1 million parameters and automatically sets up skeletons (rigs) for 3D creature models, assigns skin weights, and generates motion animations. Written from scratch in pure numpy with a custom automatic differentiation engine without using PyTorch, inference runs directly in the browser using JavaScript. The architecture combines a body shape recognition module and a miniature MotionGPT transformer that creates pose sequences from text prompts.
Key features
- Written from scratch: Pure numpy without heavy machine learning libraries.
- Two main parts: RigNet for joint prediction from surfaces and MotionGPT for motion generation.
- Browser inference: The model runs locally in a web environment using exported weights.
- Six basic body plans: Support for bipeds, quadrupeds, birds, fish, snakes, and insects.
What you can do
- Run model inference directly in Node.js or test its performance in the browser.
- Automatically place bones and set up vertex weights for created 3D creature meshes.
- Generate animation pose sequences for characters using text commands like
quadruped:run. - Use the resulting animated characters in interactive web scenes.
Example
Running inference in Node.js to generate a rig and running animation:
['sculpt','species','objects','brain'].forEach(f => require('./code/engine/' + f + '.js'));
const B = globalThis.RigBrain, S = globalThis.RigSculpt;
B.loadWeights(JSON.parse(require('fs').readFileSync('browser_weights_fp16.json')));
const fox = S.makeCreature({ family: 'quadruped', species: 'fox', seed: 1 });
const rig = B.learnedRig(fox.verts, fox.faces);
const poses = B.writeMotion('quadruped', 'run', 60, S.RNG(1));Read more
DetailsTotal size: ≈1.07 million parameters (RigNet — 234K, MotionGPT — 755K, pose tokenizer — 77K)
Training: Procedural data, about 17 minutes for RigNet and 26 minutes for MotionGPT on 1 CPU core
Limitations: Only 6 fixed body types are supported, training was conducted on procedural data rather than motion capture (mocap)










Comments