Hy4-flash
by tencent
Tencent's open-weight image and text model: 220B mixture-of-experts with about 12B active per token, a SigLIP2 vision encoder and a 1M-token context
tencent/Hy4-flashDeploy Hy4-flash
Single-tenantMixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.
Overview
Hy4 flash is a vision-language model from Tencent, released on Hugging Face on November 17, 2026 under the Tencent Hy License. It takes text and images as input and writes text, with a context window of 1,048,576 tokens. Tencent calls it the most cost-effective Hy model so far: 220B parameters in total, counting 63.5B of learned n-gram (Engram) tables, with about 11.3B text parameters and the 0.43B vision encoder active for each token.
The vision side is a SigLIP2-So400m encoder adapted at 512-pixel patches and joined to the language backbone by an MLP projector. The backbone has 42 layers, 41 of them mixture-of-experts, where each token uses 16 of 512 routed experts plus one shared expert, and attention interleaves sparse and sliding-window layers. A built-in 0.85B drafter, DFly2, speeds up decoding by speculation.
On Tencent's internal WorkIndex, which includes audio and video processing and visual understanding tasks, it scores 42.1 against 39.7 for Hy4 preview at about 1/13 of the cost per task. For a media pipeline, it reads frames, slides and scanned pages and writes descriptions or structured fields you can index and search.
Architecture
Mixture-of-experts language backbone (42 layers: 1 dense, 41 MoE; 16 of 512 routed experts plus 1 shared expert per token; hidden size 3,072; multi-head latent attention with sparse and sliding-window layers; interleaved MRoPE for image positions) with a vision encoder adapted from SigLIP2-So400m-Patch16-Res512 through an MLP projector. Learned bigram and trigram (Engram) tables add 63.5B parameters, and a 5-layer, 0.85B DFly2 drafter supports speculative decoding.
Mixpeek SDK Integration
# Hy4 flash is not a managed extractor. Serve it yourself (Tencent's vLLM
# recipe runs the FP8 weights on 8 GPUs with --tensor-parallel-size 8), caption
# each frame, and store the caption as searchable text in a Mixpeek collection.
import base64, requests
from openai import OpenAI
llm = OpenAI(base_url="http://localhost:8000/v1", api_key="unused")
def caption(path):
b64 = base64.b64encode(open(path, "rb").read()).decode()
r = llm.chat.completions.create(
model="hy4-flash",
messages=[{"role": "user", "content": [
{"type": "image_url", "image_url": {"url": f"data:image/jpeg;base64,{b64}"}},
{"type": "text", "text": "Describe what is happening in this frame in one sentence."},
]}],
max_tokens=120,
)
return r.choices[0].message.content
requests.post(
"https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
headers={"Authorization": "Bearer API_KEY"},
json={"collection_id": "col_frame_captions",
"documents": [{"document_id": "clip-042-t0012",
"payload": {"caption": caption("clip-042_0012.jpg"),
"video": "clip-042.mp4", "start_time": 12.0}}]},
)Capabilities
- Image and text input, text output, with a 1M-token context window
- About 12B active parameters per token out of 220B in total
- Built-in DFly2 drafter for speculative decoding; Tencent reports over 150 tokens/s with 4-bit weights
- Released as instruct, FP8 instruct and pre-trained base weights
- Serves through vLLM or SGLang with an OpenAI-compatible API
Use Cases on Mixpeek
Benchmarks
| Dataset | Metric | Score | Source |
|---|---|---|---|
| WorkIndex (Tencent internal, 8 task sets) | Score | 42.1 | Model card: tencent/Hy4-flash (self-reported; Hy4 preview 39.7, Hy4 51.4) |
| Blind user evaluation (85 users, 259 tasks) | Satisfaction (of 4) | 2.79 | Model card (self-reported; Claude Haiku 5.5: 2.81) |
Performance
Tencent's serving recipes run the FP8 weights with tensor parallelism across 8 GPUs. Tencent reports decoding above 150 tokens/s with 4-bit weights and the DFly2 drafter. We have not measured it.
Common Pipeline Companions
Frequently Asked Questions
What is Hy4 flash?
An open-weight vision-language model from Tencent, released November 17, 2026. It reads text and images and writes text, has a 1M-token context, and is a 220B mixture-of-experts model with about 12B parameters active per token.
Can Hy4 flash understand images and video?
It takes images natively through a SigLIP2-based vision encoder. To work with video, sample frames and pass them as images; Tencent's internal WorkIndex includes audio and video processing tasks, but the card does not document direct video input.
What hardware does Hy4 flash need?
Tencent's vLLM and SGLang recipes serve the FP8 weights with tensor parallelism across 8 GPUs. Only about 12B parameters are active per token, so it decodes fast once loaded, but all 220B parameters still have to fit in GPU memory.
Can I use Hy4 flash commercially?
Yes, under the Tencent Hy License 1.0, which is based on Apache 2.0. A company that offers general model access to third parties as a model-as-a-service business needs a separate written license from Tencent above the thresholds in section 10, such as US$50 million in yearly revenue or 100 million monthly active users. Read the license for the exact terms.
How do I use Hy4 flash with Mixpeek?
Serve it with vLLM or SGLang, send it sampled video frames or images to caption, and upsert the captions into a Mixpeek collection. A retriever then searches those captions by meaning, alongside any image embeddings in the same namespace.
Specification
Research Paper
Hy4 flash model card (Tencent, November 2026)
arxiv.orgBuild a pipeline with Hy4-flash
Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.
Run it on your own data, free