LaRenderer: A 3D Scene Neural Renderer Supporting FLUX.2
2 min readupdated
LaRenderer transforms 3D scenes featuring PBR materials, glass, mirrors, and point lights into high-quality images from any camera angle. Its architecture encodes scenes into sparse voxels (using TRELLIS.2 SC-VAE) and generates latent representations through a flow-matching decoder, followed by sRGB decoding. The model is released in both full teacher weights (1.071B parameters) and a distilled single-step student (0.722B parameters), supporting four operating modes. This tool is designed for researchers and developers working on neural rendering and the generation of synthetic 3D environments.
Key features
- Four inference modes: Flexible choice between 5-step generation (including pair-sync variants) and ultra-fast single-step decoding.
- Third-party component integration: The model relies on powerful external networks, including FLUX.2 VAE and TRELLIS.2 SC-VAE.
- Efficient distillation: The single-step student shares the scene encoder with the teacher for instant generation.
- Precise handling of scene physics: Support for mirrors, glass, point light sources, and environments via HDR maps.
What you can do
- Render synthetic rooms: Generate high-quality images of procedurally created scenes around 4 meters in size.
- Algorithm research: Test 5-step and 1-step modes with pair-sync to evaluate quality on benchmarks.
- Pipeline integration: Use the weights alongside the neural rendering repository to prepare and render custom scenes.
Example
huggingface-cli download eternity304/LaRenderer --local-dir ./LaRenderer
python scripts/inference/prepare_scene.py --bundle my_scene --out shards/my_scene
python scripts/inference/larender_infer.py --release ./LaRenderer \
--flux2-vae ./deps/flux2_klein_4b/vae/diffusion_pytorch_model.safetensors \
--shard shards/my_scene/shard-00000.tar --mode 1step --out renders/my_sceneRead more
DetailsBenchmarks (Caustic benchmark v1, 24 scenes / 72 views, 512px): The 1step_pairsync mode achieves top results (PSNR 23.48, SSIM 0.910, LPIPS 0.121).
Hardware and dependency requirements: External networks (FLUX.2 VAE, TRELLIS.2 SC-VAE, Qwen-Image VAE) are required and must be downloaded separately.
Limitations: The model was trained on rooms approximately 4 meters in size, does not support HDR output (produces display-referred AgX sRGB), and exhibits artifacts when lights are placed very close to surfaces.








Comments