Moonshot AI - Mixture of experts - verified
Run Kimi K2.6 locally
Kimi K2.6 is a 1.03T mixture-of-experts (32B active) model from Moonshot AI with a 262K-token context window, released under Modified MIT (commercial use is allowed with conditions set out in the license); the smallest listed download is 583.7 GB, the UD-Q4_K_XL GGUF build from unsloth/Kimi-K2.6-GGUF.
Official weights: moonshotai/Kimi-K2.6 - modalities: text, image, video
- Total params
- 1.03T
- Active params
- 32B
- Context
- 262K
- Smallest download
- 583.7 GB
Fits in
Smallest download at most 85% of memoryNone of the tiers here. The smallest listed download is 583.7 GB, more than 85% of 256 GB.
Downloads
The official weights and every quantization listed for this model, with file sizes from Hugging Face.
| Download | Format | Size | Repo |
|---|---|---|---|
Official weights | INT4 | 595.2 GB | moonshotai/Kimi-K2.6 |
UD-Q4_K_XLSmallest listed | GGUF | 583.7 GB | unsloth/Kimi-K2.6-GGUF |
UD-Q8_K_XL | GGUF | 594.5 GB | unsloth/Kimi-K2.6-GGUF |
GB is decimal: 1 GB = 10^9 bytes. Add memory for the context and the operating system on top of the file size.
Run it
The official pages read for this directory publish no copyable run command for Kimi K2.6. Download the weights from moonshotai/Kimi-K2.6 and follow the model card's serving instructions.
Not sure which runtime to use? Compare local LLM runtimes by platform, API and features.
License
- License
- Modified MIT
other - Commercial use
- Commercial use: ConditionsCommercial use is allowed with conditions set out in the license.
- Gated download
- No. The files download directly.
Worth knowing
Weights ship natively in INT4, so the HF parameter count reflects packed tensors rather than the 1T total stated on the card.
Released (Hugging Face repo creation date).
FAQ
How big is the Kimi K2.6 download?
The official INT4 weights in moonshotai/Kimi-K2.6 are 595.2 GB. The smallest listed download is 583.7 GB, the UD-Q4_K_XL GGUF build from unsloth/Kimi-K2.6-GGUF. Plan for more memory than the file size: the context (KV cache) and the operating system need room too.
Can I use Kimi K2.6 commercially?
Kimi K2.6 is released under Modified MIT, and commercial use is allowed with conditions set out in the license. The license text is at https://huggingface.co/moonshotai/Kimi-K2.6/blob/main/LICENSE.
How much memory do I need for Kimi K2.6?
Its smallest listed download is 583.7 GB, more than 85% of 256 GB, so it needs a multi-GPU server or a machine with more memory than the largest tier here.
What is the context length of Kimi K2.6?
262,144 tokens. A longer context needs more memory for the KV cache, so you can run with a shorter one when memory is tight.
Sources
Last verified from the pages below.
- Hugging Face model card - huggingface.co
- Hugging Face API - huggingface.co
- unsloth GGUF - huggingface.co
Newsletter
New open weights, every week
One email per week. New model releases, open-weight drops and what they mean for what you build.
Keep exploring
Best local AI models
Our curated picks by hardware tier, with benchmarks and the reasoning.
Model API pricing and specs
First-party prices per 1M tokens when you would rather call an API.
AI benchmark leaderboards
Sourced scores, for when you need to compare quality.
Setup guides
Point your coding tools at the model you picked.