Cohere - Dense - verified
Run Cohere Aya Expanse 32B locally
Cohere Aya Expanse 32B is a 32.3B dense model from Cohere with a 131K-token context window, released under CC BY-NC 4.0 (Cohere Labs) (commercial use is not allowed); the smallest listed download is 19.8 GB, the Q4_K_M GGUF build from bartowski/aya-expanse-32b-GGUF.
Official weights: CohereLabs/aya-expanse-32b
- Total params
- 32.3B
- Architecture
- Dense
- Context
- 131K
- Smallest download
- 19.8 GB
Fits in
Smallest download at most 85% of memoryDownloads
The official weights and every quantization listed for this model, with file sizes from Hugging Face.
| Download | Format | Size | Repo |
|---|---|---|---|
Official weights | F16 | 64.6 GB | CohereLabs/aya-expanse-32b |
Q4_K_MSmallest listed | GGUF | 19.8 GB | bartowski/aya-expanse-32b-GGUF |
Q8_0 | GGUF | 34.3 GB | bartowski/aya-expanse-32b-GGUF |
GB is decimal: 1 GB = 10^9 bytes. Add memory for the context and the operating system on top of the file size.
Run it
Copied verbatim from the page linked under each command. Server commands from model cards often assume a multi-GPU node; check the flags before you run them.
Not sure which runtime to use? Compare local LLM runtimes by platform, API and features.
License
- License
- CC BY-NC 4.0 (Cohere Labs)
cc-by-nc-4.0 - Commercial use
- Commercial use: NoCommercial use is not allowed.
- Gated download
- Yes. Hugging Face asks you to accept the terms before downloading.
Worth knowing
Gated non-commercial multilingual model covering 23 languages, distributed in FP16.
Released (Hugging Face repo creation date).
FAQ
How big is the Cohere Aya Expanse 32B download?
The official F16 weights in CohereLabs/aya-expanse-32b are 64.6 GB. The smallest listed download is 19.8 GB, the Q4_K_M GGUF build from bartowski/aya-expanse-32b-GGUF. Plan for more memory than the file size: the context (KV cache) and the operating system need room too.
Can I use Cohere Aya Expanse 32B commercially?
Cohere Aya Expanse 32B is released under CC BY-NC 4.0 (Cohere Labs), and commercial use is not allowed. The Hugging Face download is gated: you accept the license terms before it starts. The license text is at https://cohere.com/c4ai-cc-by-nc-license.
How much memory do I need for Cohere Aya Expanse 32B?
By this directory's rule of thumb it fits in 24 GB and up: the smallest listed download, 19.8 GB, is at most 85% of 24 GB, which leaves room for the context and the operating system.
How do I run Cohere Aya Expanse 32B with Ollama?
Run "ollama run aya-expanse:32b", as shown at https://ollama.com/library/aya-expanse:32b. The Ollama library lists the aya-expanse:32b tag at 20GB.
What is the context length of Cohere Aya Expanse 32B?
131,072 tokens. A longer context needs more memory for the KV cache, so you can run with a shorter one when memory is tight.
Sources
Last verified from the pages below.
- HF API (params, license, createdAt) - huggingface.co
- HF file tree - huggingface.co
- Model card (model page) - huggingface.co
- Ollama tags - ollama.com
- GGUF tree (bartowski) - huggingface.co
Newsletter
New open weights, every week
One email per week. New model releases, open-weight drops and what they mean for what you build.
Keep exploring
Best local AI models
Our curated picks by hardware tier, with benchmarks and the reasoning.
Model API pricing and specs
First-party prices per 1M tokens when you would rather call an API.
AI benchmark leaderboards
Sourced scores, for when you need to compare quality.
Setup guides
Point your coding tools at the model you picked.