Ai2 - Hybrid - verified
Run Ai2 Olmo Hybrid Instruct DPO 7B locally
Ai2 Olmo Hybrid Instruct DPO 7B is a 7.4B hybrid model from Ai2 with a 33K-token context window, released under Apache 2.0 (commercial use is allowed); the smallest listed download is 14.9 GB, the official BF16 weights.
Official weights: allenai/Olmo-Hybrid-Instruct-DPO-7B
- Total params
- 7.4B
- Architecture
- Hybrid
- Context
- 33K
- Smallest download
- 14.9 GB
Fits in
Smallest download at most 85% of memoryDownloads
The official weights and every quantization listed for this model, with file sizes from Hugging Face. No quantized build was found from the usual publishers.
| Download | Format | Size | Repo |
|---|---|---|---|
Official weightsSmallest listed | BF16 | 14.9 GB | allenai/Olmo-Hybrid-Instruct-DPO-7B |
GB is decimal: 1 GB = 10^9 bytes. Add memory for the context and the operating system on top of the file size.
Run it
The official pages read for this directory publish no copyable run command for Ai2 Olmo Hybrid Instruct DPO 7B. Download the weights from allenai/Olmo-Hybrid-Instruct-DPO-7B and follow the model card's serving instructions.
Not sure which runtime to use? Compare local LLM runtimes by platform, API and features.
License
- License
- Apache 2.0
apache-2.0 - Commercial use
- Commercial use: YesCommercial use is allowed.
- Gated download
- No. The files download directly.
Worth knowing
Hybrid RNN (linear attention plus full attention) model that needs transformers 5.3.0 or newer; the card only gives Python examples and no context length, so the figure is config.json max_position_embeddings.
Released (Hugging Face repo creation date).
FAQ
How big is the Ai2 Olmo Hybrid Instruct DPO 7B download?
The official BF16 weights in allenai/Olmo-Hybrid-Instruct-DPO-7B are 14.9 GB. No smaller quantization is listed. Plan for more memory than the file size: the context (KV cache) and the operating system need room too.
Can I use Ai2 Olmo Hybrid Instruct DPO 7B commercially?
Ai2 Olmo Hybrid Instruct DPO 7B is released under Apache 2.0, and commercial use is allowed. The license text is at https://www.apache.org/licenses/LICENSE-2.0.
How much memory do I need for Ai2 Olmo Hybrid Instruct DPO 7B?
By this directory's rule of thumb it fits in 24 GB and up: the smallest listed download, 14.9 GB, is at most 85% of 24 GB, which leaves room for the context and the operating system.
What is the context length of Ai2 Olmo Hybrid Instruct DPO 7B?
32,768 tokens. A longer context needs more memory for the KV cache, so you can run with a shorter one when memory is tight.
Sources
Last verified from the pages below.
- HF API (params, license, createdAt) - huggingface.co
- HF file tree - huggingface.co
- Model card - huggingface.co
- config.json - huggingface.co
- HF search (no GGUF or MLX quants found) - huggingface.co
Newsletter
New open weights, every week
One email per week. New model releases, open-weight drops and what they mean for what you build.
Keep exploring
Best local AI models
Our curated picks by hardware tier, with benchmarks and the reasoning.
Model API pricing and specs
First-party prices per 1M tokens when you would rather call an API.
AI benchmark leaderboards
Sourced scores, for when you need to compare quality.
Setup guides
Point your coding tools at the model you picked.