Mundus 0.1
Autonomous Neural Game Engine
2 min read
Mundus 0.1 is a two-stage causal transformer world model designed to simulate latent dynamics, interactive environments, and model-based reinforcement learning. It compresses visual frames using VQ-VAE (an image discretization method) and predicts future frames, collisions, and rewards in response to player actions. Available in 88.2M and 232.1M parameter versions, the model runs on modest hardware (requiring from 1.68 GB of VRAM) and is useful for game developers, AI researchers, and interactive neural network enthusiasts.
Key features
- Two-stage architecture: Combines a VQ-VAE visual tokenizer and a Causal Dynamics Engine built on SwiGLU transformer blocks.
- Interactive web player: Lets you run simulations in the browser and control the agent in real time using arrow keys or the keyboard.
- Imagination generation: Generates autoregressive GIF animations of expanded scenarios (model "hallucinations").
- Efficiency: The smaller 88.2M parameter version is optimized for budget GPUs like the GTX 1050.
What you can do
- Run a web simulation: Play in the browser via a local server, switching between pure neural generation and physics.
- Create a GIF animation: Generate a sequence of future frames (rollout) using the `imagine.py` script.
- Train from scratch: Run transformer dynamics training on your own trajectories and game data.
- Run on a PC: Use the built-in Pygame interface to test the model on your desktop.
Example
Launching the interactive browser engine with a model checkpoint:
python3 web_player.py --checkpoint checkpoints/mundus_0.1_step_45000.pt --port 8080Read more
DetailsParameters: 88.2M (active) and 232.1M (high-capacity) parameters.
Architecture: 12 or 18 SwiGLU transformer blocks, hidden dimension 768 / 1024, RoPE (rotary positional embeddings).
Hardware requirements: From 1.68 GB of VRAM for the 88.2M version up to 3.52 GB of RAM for the 232.1M version.
License: MIT.










Comments