DeepSeek-V4.1-Flash-1017-radiance
Running DeepSeek-V4.1 on AMD GPUs
2 min readupdated
Developer aselzer converted the DeepSeek-V4.1-Flash-1017 large language model into the .rad format for the AMD-focused radiance inference engine. This build is designed to reproduce high-load batching benchmarks from the BatchSeek project (handling 512 concurrent requests). Inside the main file, the original experts are preserved in MXFP4 encoding alongside the remaining weights in BF16/F32, while Engram tables are added in IQ4_NL compression. It is built for enthusiasts and researchers running large MoE models on clusters of consumer AMD cards without NVIDIA hardware.
Key features
- radiance format (.rad): The main 416 GB file was compiled using the radiance converter (commit
bd65d4e) with DeepSeek-V4.1 architecture support. - Chunked downloads: The model is split into 8 parts of roughly 52 GB each, complete with checksum verification via
SHA256SUMS. - Two Engram table modes: Built-in quantized IQ4_NL tables are used by default, though you can attach the original FP8 shards (+203 GB) with no performance penalty.
- Permissive MIT license: The weights belong to DeepSeek; this repository only changes the storage format.
What you can do
- Reproduce BatchSeek benchmarks: Test parallel generation across 512 streams using the
serve-batch.shscript. - Deploy a local AMD GPU server: Run the model across a multi-GPU Radeon setup (tested on 4× RX 9070 XT) paired with high-capacity system RAM.
- Compare quantization accuracy: Benchmark the built-in IQ4_NL tables against the original FP8 shards on your own workloads.
Example
./serve-batch.sh --model model.rad --silu-table silu_table_gfx1201.bin --streams 512 \
--engram-file engram-fp8/model-00047-of-00048.safetensors,engram-fp8/model-00048-of-00048.safetensorsRead more
DetailsBIRD 256 benchmark: 170 s (NLL 0.688) with the original FP8 tables vs. 172 s (NLL 0.692) with the built-in IQ4_NL tables.
Test rig: 4× AMD RX 9070 XT (16 GB VRAM each, gfx1201 architecture), EPYC 7443 CPU, and 256 GB DDR4.
File sizes: 416 GB for
model.rad, plus 203 GB if using the optional engram-fp8 shards.









Comments