Topic
QUANTIZATION
All blog posts, tools, and guides about Quantization from Developers Digest.
3 resources - 2 posts, 1 tool
Blog Posts
View in blog →
Bonsai 27B: How PrismML Fit a 27 Billion Parameter Model on Your Phone
PrismML's Bonsai 27B uses 1-bit quantization to compress a 27B model to 3.9GB - small enough to run on an iPhone. Here's how it works and what HN thinks.
6 min read
GLM-5.2 Local Deployment: Running Z.ai's 744B Model on Consumer Hardware
Unsloth's dynamic quantization makes GLM-5.2 runnable on a 256GB Mac or a 24GB GPU with CPU offloading. Here is the hardware math, the quantization tradeoffs, and what the HN community learned from actually running it.
7 min read
Keep exploring
More on Quantization
- - llama.cpp - recommended Quantization tool from the Developers Digest directory
- - Compare Tools - dive deeper across the Developers Digest knowledge base
- - All Quantization articles in the blog archive
- - Developers Digest on YouTube - video tutorials covering Quantization and more
Get Smarter About AI Dev
New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.
One email per weekReal code, not theoryFree forever
Explore 916 topics
Browse All Topics