
Kimi K3
3 partsTL;DR
Kimi K3 brings 2.8 trillion parameters, native vision, a 1M-token context window, and long-horizon agent workflows. Here is what developers should know before adopting it.
Last updated: July 17, 2026
Kimi K3 is Moonshot AI's biggest swing yet: a 2.8-trillion-parameter Mixture-of-Experts model with native vision, a 1-million-token context window, and an explicit focus on long-running coding and knowledge-work agents.
The headline numbers are enormous. The practical questions are smaller: Can you use it today? What does it cost? Are the weights actually available? And does a 1M-token window make it a better coding model?
| Detail | Kimi K3 |
|---|---|
| Total parameters | 2.8 trillion |
| Architecture | Mixture of Experts with Kimi Delta Attention and Attention Residuals |
| Active experts | 16 of 896 per routing step |
| Context window | 1 million tokens |
| Modalities | Native text and vision |
| API price | $3/M input, $0.30/M cached input, $15/M output |
| Availability | Kimi, Kimi Work, Kimi Code, and API |
| Open weights | Promised by July 27, 2026 |
The most important caveat is timing. Kimi calls K3 an open model, but the full weights were not downloadable on publication day. Moonshot says they will arrive by July 27 alongside more architecture, training, and evaluation detail. Until then, the API and hosted products are the practical ways to use it.
K3 is not just K2 with more experts. Moonshot highlights three architectural changes.
Kimi Delta Attention is a hybrid attention system intended to make long sequences more efficient. Attention Residuals changes how information flows between layers, allowing later blocks to draw from earlier representations instead of relying on one strictly sequential residual stream. Stable LatentMoE increases sparsity: K3 routes work through 16 of 896 experts.
Moonshot claims these changes deliver roughly 2.5 times better scaling efficiency than K2. That is a vendor claim, not an independently reproduced result, but it explains why the lab is emphasizing architecture rather than parameter count alone.
Newsletter
Get the weekly deep dive
Tutorials on Claude Code, AI agents, and dev tools, delivered free every week.
From the archive
Jul 17, 2026 • 6 min read
Jul 16, 2026 • 7 min read
Jul 16, 2026 • 6 min read
Jul 16, 2026 • 7 min read
A million tokens can hold a large monorepo, a long research archive, or days of agent history. That removes some chunking pressure, but capacity and comprehension are different things.
For coding agents, the strongest use is selective retrieval across a large working set. Give the agent repository maps, test output, relevant source files, and a durable task log. Do not dump a million tokens into every request and assume the model will locate the one important line. Larger prompts still cost more, take longer, and create more opportunities for irrelevant context to distract the model.
At Kimi's published API pricing, a full 1M-token uncached prompt costs about $3 before output. With a cache hit it is about $0.30. That makes prompt caching central to any serious K3 workflow.
Moonshot's most convincing examples are long-horizon engineering tasks rather than short code-generation benchmarks.
In one 15-hour kernel-optimization run, K3 reportedly reduced an AttnRes training operation from 283.6 ms to 114.4 ms. In another task it wrote an MLA kernel that reached 517.8 TFLOPS. The model also built a compact Triton-like compiler, created browser-based 3D games through screenshot feedback, and completed a computational astrophysics reproduction workflow involving more than 20 papers and 3,000 lines of Python.
These are curated demonstrations run by the model maker. They do not prove that K3 will repair your production incident. They do show the product direction: observe a working environment, use tools, run for hours, inspect results, and keep iterating.
The lowest-friction options are Kimi for general work and Kimi Code for terminal and IDE workflows. Developers building applications can use the Kimi API.
K3 launches with maximum thinking effort as the default. Moonshot says low- and high-effort modes will follow. That means latency and output cost deserve measurement before you put the model behind a user-facing interaction.
If self-hosting is the goal, wait for the weights and serving guidance. A 2.8T sparse model is still a very large systems project. "Open weights" does not mean "runs on a workstation," and the eventual quantization and inference-partner support will matter more than the raw license label.
Try K3 now if your work combines large context, terminal tools, visual feedback, and long autonomous runs. Keep your existing model routing if most tasks are short, latency-sensitive, or already reliable on a cheaper model.
Moonshot makes an unusually useful admission in its own launch post: K3 still trails the most powerful proprietary models overall. That candor is a better adoption frame than any single benchmark chart. K3 does not need to win every test to matter. A capable open-weight model with native vision and a 1M-token window can change the cost and control floor for agent builders.
Moonshot describes K3 as open and says the full model weights will be released by July 27, 2026. As of July 17, the weights were not yet available, so self-hosting claims should wait for the actual release and license.
Kimi lists $3 per million uncached input tokens, $0.30 per million cached input tokens, and $15 per million output tokens. Prices were verified July 17, 2026.
Not yet. The weights have not been released, and a sparse 2.8T model will require serious inference hardware even after optimized formats arrive.
Moonshot reports frontier-level results on several internal and curated evaluations, but its launch post says K3 still trails the strongest proprietary models overall. Test it on your own workload instead of treating vendor benchmark suites as a universal ranking.
Read next
Kimi K2.7-Code is Moonshot's open-source 1T parameter coding model with 30% fewer reasoning tokens than K2.6. Here's how to set it up with Claude Code, pricing breakdown, and honest benchmark analysis.
8 min readMoonshot AI's Kimi CLI offers unlimited coding sessions at zero marginal cost. Claude Code offers polish, deep Anthropic integration, and a subscription most serious devs already hold. Here is how to decide.
8 min readKimi K3 adds native vision, a 1M-token window, and longer agent runs, but K2.7 remains cheaper and easier to deploy. Here is the practical upgrade decision.
6 min readTechnical content at the intersection of AI and development. Building with AI agents, Claude Code, and modern dev tools - then showing you exactly how it works.
Open-source terminal coding agent from Moonshot AI. Powered by Kimi K2.5 (1T params, 32B active). 256K context window. A...
View ToolFactory AI's terminal coding agent. Runs Anthropic and OpenAI models in one subscription. Handles full tasks end-to-end...
View ToolFastest inference for open-source models. 200+ models via unified API. Ranks #1 on speed benchmarks for DeepSeek, Qwen,...
View ToolOpen-source terminal agent runtime with approval modes, rollback snapshots, MCP servers, LSP diagnostics, and a headless...
View ToolSee exactly what your agent did, locally. No cloud, no signup.
View AppTrack open-source maintenance signals, release tasks, and repo follow-ups in one dashboard.
View AppBeat the August 2026 Assistants API sunset. Paste old code, get Responses API.
View AppInstall Ollama and LM Studio, pull your first model, and run AI locally for coding, chat, and automation - with zero cloud dependency.
Getting StartedWhat MCP servers are, how they work, and how to build your own in 5 minutes.
AI AgentsStage, commit, branch, and open PRs without leaving the session.
Claude Code
NVIDIA just released Nemotron Nano 2 VL - an open-source vision language model that's 4x more efficient than previous models. In this video, I break down what makes this 12-billion parameter...

Learn The Fundamentals Of Becoming An AI Engineer On Scrimba; https://v2.scrimba.com/the-ai-engineer-path-c02v?via=developersdigest OpenAI's New O1 Model and $200/Month ChatGPT Pro Tier: What's...

Check out Zed here! https://zed.dev In this video, we dive into Zed, a robust open source code editor that has recently introduced the Agent Client Protocol. This new open standard allows...

Kimi K2.7-Code is Moonshot's open-source 1T parameter coding model with 30% fewer reasoning tokens than K2.6. Here's how...

Moonshot AI's Kimi CLI offers unlimited coding sessions at zero marginal cost. Claude Code offers polish, deep Anthropic...

Kimi K3 adds native vision, a 1M-token window, and longer agent runs, but K2.7 remains cheaper and easier to deploy. Her...

A Kimi-generated macOS 27 concept shows the promise and limits of screenshot-driven website creation. Here is how K3's v...

Moonshot AI releases Kimi K3 with 2.8 trillion parameters, 1M context window, and Delta Attention architecture. Here's w...

Days after getting caught uploading entire codebases to xAI servers, Grok Build is now open source on GitHub. The HN com...

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.