Skip to main content
Watch: Grok Bot Built My AI Video Arena While I Tested 8 Models

MOE

6 items

4 posts, 2 tools

Blog
Tencent Hy4 Preview: 770B Open MoE, Agentic Benchmarks, and Where It Fits in 2026

Tencent Hy4 preview is a 770B open MoE with 49B active under Apache 2.0. Architecture, posted agentic benchmarks, OpenRouter pricing and self-hosting needs.

Blog
Tencent Hy3: A 295B Open MoE That Punches Above Its Weight

Tencent's Hy3 ships 295B parameters but activates only 21B per token, matching flagship performance at flash-tier pricing under Apache 2.0.

Tool
DeepSeek V4

DeepSeek's open-weights frontier family, previewed April 24, 2026. V4-Pro is 1.6T total / 49B active params; V4-Flash is 284B / 13B. 1M context standard. Weights on Hugging Face.

Blog
NVIDIA Nemotron 3 Super: A Developer's Guide to the 120B Hybrid MoE

Nemotron 3 Super developer guide: the latent MoE hybrid Mamba architecture, hardware needs, reasoning modes, and code to run NVIDIA's 120B model.

Tool
Qwen3-Coder

Alibaba's open-weight coding model, released in 2025. 480B total parameters, 35B active (MoE). Native 256K context, extends to 1M. Apache 2.0 license. Built for agentic coding.

Blog
NVIDIA's Nemotron 3 Super in 6 Minutes

NVIDIA Nemotron 3 Super combines latent mixture of experts with hybrid Mamba layers - 120B total parameters, 12B active per token, 1M context and open weights.

AI Development Stack

Get Smarter About AI Dev

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.

One email per weekReal code, not theoryFree forever