On August 27, Tencent Hunyuan announced its next-generation flagship Hy4 preview and open-sourced the weights: 770B total parameters, 49B activated per token, a 1M context window, Apache 2.0 licensing, with BF16 and FP8 weights landing simultaneously on Hugging Face, ModelScope, GitCode, and CNB. The parameter count is just the appetizer - the most striking line in the official announcement is that Hy4 preview participated for the first time in the automated optimization of its own training process, "establishing an early-stage recursive self-improvement loop." A flagship model shipping open-source with the footnote "it helped train itself" is a first for the open-source camp.
Scope note: this article is based on Tencent's official press release (2026-08-28), the Hunyuan GitHub README, and public reporting (as of 2026-08-29). GitHub stars are an API snapshot from 2026-08-29; blind-eval figures are Tencent's internal evaluation methodology; API prices are snapshots and the official pages prevail. Not investment advice.
1. Third Major Release in Six Months: The Preview Playbook Is Working
First, the cadence. This is Tencent Hunyuan's third major model release in six months (per Pandaily). Back in May, Hy3 preview topped OpenRouter's call volume under an anonymous, low-price identity (input as low as $0.066 per million tokens) - the community rushed in first, and the official reveal came later. Hy4 preview follows the same "preview first, collect real-world feedback, then ship the official version" path. The press release puts it directly: "Through a preview-first approach, followed by official releases, Hunyuan continuously incorporates real-world feedback into its research and development process."
The GitHub repository Tencent-Hunyuan/Hy4-preview was created on August 27 and had gathered 245 stars and 10 forks by August 29. For a 770B model, stars are not the point - full weight openness is: both BF16 and FP8 versions are up on four platforms under Apache 2.0, free for commercial use. Tencent also teases that "the next batch of models in the Hy4 series is expected to roll out soon" - the preview is only the opening act.
2. Architecture: 78 MoE Layers, Only 49B Activated per Token
The spec sheet, from the README (backbone only, excluding the MTP layer):
| Property | Value |
|---|---|
| Total parameters | 770B |
| Activated parameters | 49B |
| Layers | 78 (first layer dense FFN + 77 MoE layers) |
| Expert config | 256 routed experts + 1 shared expert per layer; top-8 routed + shared activated per token |
| Hidden size | 6144 |
| Attention | Gated DSA (64 heads), sparse indexer top-k 2048 |
| Residual streams | 4 (iHC hyper-connections) |
| Context length | 1M |
| Vocabulary | 120,832 |
Three technical points deserve a closer look. First, attention: Gated DeepSeek Sparse Attention (Gated DSA, arXiv:2512.02556) with IndexCache (arXiv:2603.12201) for cross-layer sparse index reuse - the README says outright that the design is "inspired by DeepSeek and GLM," naming its peers as teachers in the technical report. Second, the residual pathway: iHC (identity Hyper-Connections) expands inter-layer information flow into 4 residual streams, giving gradients and information multiple routes through 78 layers of depth. Third, a native MTP layer (10B total / 0.7B activated) built for speculative decoding, accepting 3 draft tokens by default at deployment - a key lever for keeping inference costs down on a 770B model.
For anyone deploying it, the threshold number is "all 770B weights resident in VRAM, only 49B computed per token": a small activation saves compute and per-token latency, but the memory bill shrinks not at all. The companion SOP in this batch walks through the official prebuilt-image deployment path, and the companion review lines up the open-source flagships' deployment thresholds in one table.
3. Blind Eval: 163 Tencent Experts Score It 2.99, Slightly Ahead of GLM-5.3 and Kimi K3
Tencent's evaluation methodology is unusual: instead of chasing leaderboards, it had 163 internal experts (software engineers, game developers, finance analysts, security experts) blind-rate outputs on 203 real engineering tasks. Hy4 preview scored 2.99/4.00:
| Model | Blind-eval average (out of 4) | Win / Tie / Loss |
|---|---|---|
| Hy4 preview | 2.99 | -- |
| GLM-5.3 | 2.92 | 46.8% / 12.8% / 40.4% |
| Kimi K3 | 2.94 | 51.2% / 7.9% / 40.9% |
The win rates are solid (46.8% against GLM-5.3, 51.2% against Kimi K3), but ties plus losses also add up to over 40% in both matchups - this is "slightly ahead," not "generational gap," and Tencent's own wording stays modest. What makes the methodology notable is the subject matter: expert blind ratings on real engineering tasks track the "actually gets work done" feel better than academic benchmarks do. It remains a Tencent self-evaluation, though - cross-validation will have to wait for the community to run it.
The README's Known Limitations section is refreshingly candid: it admits this is an early version of Hy4, with known issues including "spending longer than necessary reasoning through complex tasks" and "a tendency to over-verify its own work," and promises rapid iteration. Publishing your model's shortcomings on launch day sets a new bar for the open-source flagship race.
4. Recursive Self-Improvement: The Model Participated in Its Own Training
This is the real hook of the release. From the official press release: Hy4 preview participated "for the first time in the automated optimization of training methods, data strategies, evaluation frameworks, and low-level operators. The model proposed approaches, ran experiments, and iterated based on the results, with the resulting code, logs, and feedback feeding into subsequent rounds of exploration. This established an early-stage recursive self-improvement loop."
Unpacked, the model plays three roles in the loop - proposer, experiment runner, and result evaluator: it suggests improvements to the training pipeline it is itself being built with, runs the experiments, and iterates on the data, with the outputs feeding the next round. Tencent's disclosure here stays qualitative ("early-stage"); there is no quantified breakdown of how much these automated optimizations contributed to the final model's capability. Keep that boundary in view.
But one quantified data point is worth the record: Hy4 preview also autonomously analyzed bottlenecks in its own inference system and ran multiple rounds of optimization around operator fusion and communication, lifting end-to-end throughput 31.8% versus baseline, with consistent gains across different context lengths and concurrency levels. In other words, "the model optimizing its own inference infrastructure" has moved from vision to a deliverable with a number attached. The 2026 agent narrative has been stuck at "AI writes code, humans review" - this round moves it half a step forward: AI-written optimization code serving the model's own runtime.
5. Pricing and Access: $0.834 Input, Two Weeks Free on WorkBuddy/CodeBuddy
API pricing (official figures, per million tokens): $0.834 input, $2.501 output, $0.042 cache hit. The cache-hit price is 1/20th of the input price - friendly territory for agent-style, long-context workflows.
| Item (per million tokens) | Price |
|---|---|
| Input | $0.834 |
| Output | $2.501 |
| Cache hit | $0.042 |
Access channels: WorkBuddy, CodeBuddy, Yuanbao, ima, and other Tencent products offer the model directly; the API runs through Tencent Cloud TokenHub and OpenRouter. From launch, Hy4 preview is free on WorkBuddy and CodeBuddy for two weeks, and free access to Hy3 on both platforms has been extended until September 30. For individual developers, the cheapest validation path is a round of real tasks inside CodeBuddy during the free window; if you want to self-host, jump straight to the companion SOP.
6. The Takeaway: The Open-Source Flagship Race Enters Its Self-Improving Half
Put Hy4 preview back into the open-source flagship lineup - GLM-5.3, Kimi K3, the DeepSeek V4 series - and the contest is no longer just leaderboard scores. It is a composite exam of parameter scale, deployment threshold, API pricing, and real performance on engineering tasks. Tencent's play this time: 770B fully open weights to show good faith, 49B activation plus MTP to control inference cost, expert blind evals to certify engineering capability, and a free window to lower the trial barrier.
The "participated in its own training" narrative matters more in the long run than any score. It signals that the flagship-model development process itself is starting to be rewritten by the model: evaluation frameworks, data strategies, and operators - stages once owned entirely by engineers - now carry the model's own contributions. Whether the loop is real and how much it delivers, time will tell; but the direction is already in the official press release: "The next batch of models in the Hy4 series is expected to roll out soon." Models building models will likely be the headline of that next batch.
One-line closer: when 770B weights ship fully open, 49B activation keeps costs in check, expert blind evals certify a slight lead - and the model helped train itself - the open-source flagship race has formally moved from "who scores higher" to "who gets the self-improvement loop running first."
References
-
Tencent official press release (2026-08-28): Tencent Releases and Open-Sources Tencent Hy4 preview, https://www.tencent.com/tencent-releases-and-open-sources-tencent-hy4-preview
-
Tencent Hunyuan GitHub repository (Apache 2.0; architecture specs and deployment docs): https://github.com/Tencent-Hunyuan/Hy4-preview
-
Hugging Face model page (BF16/FP8 weights): https://huggingface.co/tencent/Hy4-preview
-
Pandaily (2026-08): Tencent Hunyuan Hy4 Preview Open Source, https://pandaily.com/tencent-hunyuan-hy4-preview-open-source
-
Gated DSA paper: https://arxiv.org/abs/2512.02556 ; IndexCache paper: https://arxiv.org/abs/2603.12201
-
Related reading: companion pieces Hy4 Preview Self-Hosting SOP and Open-Source Flagship Five-Way Comparison; earlier coverage The Mystery Model "Ox-Alpha" Revealed: Zhipu Open-Sources GLM-5.3-Flash, Lightweight Flagship API Five-Way Comparison, and GLM-5.3 Deep Dive
This article is based on the official press release, GitHub README, and public reporting (as of 2026-08-29). Prices and star counts are snapshots; the official pages prevail. Not investment advice.