Hy4-Flash: A 220B Multimodal Model by Tencent Hunyuan
2 min read
Hy4-Flash is a large-scale general-purpose multimodal model developed by Tencent Hunyuan and adapted for the FlagOS ecosystem to run on diverse hardware platforms. The model features approximately 220 billion total parameters (including around 64 billion Engram parameters) and activates roughly 12 billion parameters per token. It supports text and image processing, a context length of up to 1 million tokens, and a hybrid architecture featuring Latent MoE (Mixture of Experts). The model is optimized for office scenarios, including deep search, document processing, and presentation generation, delivering reduced KV Cache memory consumption and high throughput.
Key features
- Native support for text and visual inputs with a context length of up to 1 million tokens.
- Latent MoE and Engram architecture, reducing KV Cache size by six times compared to the base version of Hy4.
- Adaptation for the FlagOS stack for cross-hardware deployment on various chips (including Moore Threads, NVIDIA, and others).
- Strong benchmark results (for example, 96 on Math-500 and 92.6 on mmbench).
What you can do
- Deploy a local inference server for long-context processing and multimodal tasks.
- Use the model for workflow automation, deep search, and presentation (PPT) generation.
- Integrate the model into your workflows using ready-to-use deployment scripts and FlagOS Docker containers.
Example
An example request to a running inference server via the API using curl:
curl --fail-with-body --silent --show-error --max-time 180 \
[http://127.0.0.1:30200/v1/chat/completions](http://127.0.0.1:30200/v1/chat/completions) \
-H 'Content-Type: application/json' \
--data-binary '{"model":"Hy4-flash","messages":[{"role":"user","content":"只回答数字:1+1等于多少?"}],"temperature":0,"max_tokens":32,"stream":false,"chat_template_kwargs":{"reasoning_effort":"no_think"}}'Read more
DetailsParameters: 220.25 billion total parameters, ~12B active.
Benchmarks: Math-500 — 96, GPQA_Diamond — 92.42, mmbench — 92.6, mmstar — 80.93.
License: Apache License 2.0.
Requirements: Supports distributed inference with tensor parallel size (tp-size) 8.










Comments