Skip to main content
Watch: I Built an AI App Without Leaving Databricks

Z.ai - Mixture of experts - verified

Run GLM-5.1 locally

GLM-5.1 is a 753.9B mixture-of-experts model from Z.ai with a 203K-token context window, released under MIT (commercial use is allowed); the smallest listed download is 464.5 GB, the UD-Q4_K_M GGUF build from unsloth/GLM-5.1-GGUF.

Official weights: zai-org/GLM-5.1

Total params
753.9B
Architecture
Mixture of experts
Context
203K
Smallest download
464.5 GB

Fits in

Smallest download at most 85% of memory

None of the tiers here. The smallest listed download is 464.5 GB, more than 85% of 256 GB.

Downloads

The official weights and every quantization listed for this model, with file sizes from Hugging Face.

GLM-5.1 downloads and file sizes
DownloadFormatSizeRepo
Official weightsBF161,507.7 GBzai-org/GLM-5.1
UD-Q4_K_MSmallest listedGGUF464.5 GBunsloth/GLM-5.1-GGUF
Q8_0GGUF801.3 GBunsloth/GLM-5.1-GGUF
FP8FP8756.2 GBzai-org/GLM-5.1-FP8

GB is decimal: 1 GB = 10^9 bytes. Add memory for the context and the operating system on top of the file size.

Run it

The official pages read for this directory publish no copyable run command for GLM-5.1. Download the weights from zai-org/GLM-5.1 and follow the model card's serving instructions.

Not sure which runtime to use? Compare local LLM runtimes by platform, API and features.

License

License
MITmit
Commercial use
Commercial use: YesCommercial use is allowed.
Gated download
No. The files download directly.

Worth knowing

Z.ai publishes an official FP8 checkpoint alongside the BF16 weights.

Released (per the announcement).

API pricing and specsHosted prices per 1M tokens for GLM-5.1, if you would rather not run it yourself.

FAQ

How big is the GLM-5.1 download?

The official BF16 weights in zai-org/GLM-5.1 are 1,507.7 GB. The smallest listed download is 464.5 GB, the UD-Q4_K_M GGUF build from unsloth/GLM-5.1-GGUF. Plan for more memory than the file size: the context (KV cache) and the operating system need room too.

Can I use GLM-5.1 commercially?

GLM-5.1 is released under MIT, and commercial use is allowed. The license text is at https://huggingface.co/zai-org/GLM-5.1/blob/main/LICENSE.

How much memory do I need for GLM-5.1?

Its smallest listed download is 464.5 GB, more than 85% of 256 GB, so it needs a multi-GPU server or a machine with more memory than the largest tier here.

What is the context length of GLM-5.1?

202,752 tokens. A longer context needs more memory for the KV cache, so you can run with a shorter one when memory is tight.

Sources

Last verified from the pages below.

Newsletter

New open weights, every week

One email per week. New model releases, open-weight drops and what they mean for what you build.