6 min read
Tencent Hy3: A 295B Open MoE That Punches Above Its Weight
Tencent's Hy3 ships 295B parameters but activates only 21B per token, matching flagship performance at flash-tier pricing under Apache 2.0.
Read more
MOE
4 articles
LATEST
Tencent Hy4 Preview: 770B Open MoE, Agentic Benchmarks, and Where It Fits in 2026
Tencent's Hy4 preview ships 770B total parameters with 49B active under Apache 2.0 - a 1M-context text MoE with DeepSeek-style sparse attention, posted Terminal-Bench 85.4 and DeepSWE 64.3, and an OpenRouter price of $0.834/$2.501. Verified against the model card and the live OpenRouter page on August 31, 2026.
•9 min read
Read Article
9 min read
NVIDIA Nemotron 3 Super: A Developer's Guide to the 120B Hybrid MoE
A practical walkthrough of Nemotron 3 Super: latent mixture of experts, hybrid Mamba transformer architecture, 1M context, reasoning modes, and the code you actually need to run it on NVIDIA hardware.
5 min read
NVIDIA's Nemotron 3 Super in 6 Minutes
NVIDIA's Nemotron 3 Super combines latent mixture of experts with hybrid Mamba architecture - 120B total parameters, 12B active per token, 1M context, and up to 4x more experts at the same cost.
Showing 3 of 3 articles
Keep exploring MoE
- - MoE Topic Hub - tools and guides for MoE from the Developers Digest directory
- - Compare Tools - dive deeper across the Developers Digest knowledge base
- - Developers Digest on YouTube - video tutorials covering MoE and more
Get Smarter About AI Dev
New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.
One email per weekReal code, not theoryFree forever
Explore 819 topics
Browse All Topics