Topic
MOE
All blog posts, tools, and guides about MoE from Developers Digest.
6 resources - 4 posts, 2 tools
Blog Posts
View in blog →
Tencent Hy4 Preview: 770B Open MoE, Agentic Benchmarks, and Where It Fits in 2026
Tencent's Hy4 preview ships 770B total parameters with 49B active under Apache 2.0 - a 1M-context text MoE with DeepSeek-style sparse attention, posted Terminal-Bench 85.4 and DeepSWE 64.3, and an OpenRouter price of $0.834/$2.501. Verified against the model card and the live OpenRouter page on August 31, 2026.
9 min read
Tencent Hy3: A 295B Open MoE That Punches Above Its Weight
Tencent's Hy3 ships 295B parameters but activates only 21B per token, matching flagship performance at flash-tier pricing under Apache 2.0.
6 min read
NVIDIA Nemotron 3 Super: A Developer's Guide to the 120B Hybrid MoE
A practical walkthrough of Nemotron 3 Super: latent mixture of experts, hybrid Mamba transformer architecture, 1M context, reasoning modes, and the code you actually need to run it on NVIDIA hardware.
9 min read
NVIDIA's Nemotron 3 Super in 6 Minutes
NVIDIA's Nemotron 3 Super combines latent mixture of experts with hybrid Mamba architecture - 120B total parameters, 12B active per token, 1M context, and up to 4x more experts at the same cost.
5 min read
Related Tools
All tools →Qwen3-Coder
Alibaba's open-weight coding model, released in 2025. 480B total parameters, 35B active (MoE). Native 256K context, extends to 1M. Apache 2.0 license. Built for agentic coding.
AI ModelsDeepSeek V4
Open weightsDeepSeek's open-weights frontier family, previewed April 24, 2026. V4-Pro is 1.6T total / 49B active params; V4-Flash is 284B / 13B. 1M context standard. Weights on Hugging Face.
AI ModelsKeep exploring
More on MoE
- - Qwen3-Coder - recommended MoE tool from the Developers Digest directory
- - Compare Tools - dive deeper across the Developers Digest knowledge base
- - All MoE articles in the blog archive
- - Developers Digest on YouTube - video tutorials covering MoE and more
Get Smarter About AI Dev
New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.
One email per weekReal code, not theoryFree forever
Explore 819 topics
Browse All Topics