
llama.cpp MoE Offload: --n-cpu-moe vs the New Expert Cache
llama.cpp now caches hot MoE experts on the GPU. In the PR author's RTX 5090 run, --cpu-moe plus --moe-cache-mib decoded 2.2x faster than --fit. When to use each flag.
Page 13 of 100
Deep dives into AI agents, coding tools, and building with LLMs.
1190 articles844 topics

llama.cpp now caches hot MoE experts on the GPU. In the PR author's RTX 5090 run, --cpu-moe plus --moe-cache-mib decoded 2.2x faster than --fit. When to use each flag.

OpenAI Decisions API costs $0.10 per million input tokens, 2.4x Jev. Pick Jev for cheap text decisions, Clef-flash for speed, Decisions API for images.

Kolibri 1 runs locally from 28.6 GB (Q2_K) to 83.1 GB (Q8_0). Which quant fits your RAM or Mac, measured speeds, and why Ollama cannot load it yet.

Step 5 Preview is StepFun's 600B MoE with 27B active and a 1M window. What it scores, what a session costs, and what to check before the October 15 weights.

Claude Max and Team plans now include a monthly Claude API credit, starting at $100 on Max 5x. What it covers, what it does not, and how to claim it.

Sonnet 5.5 is the default, Opus 5.5 is for open-ended long-horizon work, and Haiku 5.5 is for bounded steps and subagents. Prices, benchmarks, cost math.

Google's Gemini agent can create coworker agents with their own Workspace account, email and audit trail. What Google announced and what builders should copy.

Melty is a free Windows launcher for AI-built game mashups. How the Claude Code and Codex workflow works, the open skill pack, and the modder backlash.

OpenAI's math repo holds hundreds of model-written manuscripts, some with Lean proofs. What Lean verifies, what it misses, and the lesson for agent output.

Claude Haiku 5.5 pricing, the cliff above 100K-token prompts, the tokenizer catch, the migration steps from Haiku 4.5, and when to use it instead of Sonnet.

Sign in with ChatGPT lets coding agents spend your Plus or Pro plan allowance instead of an API key. How the OAuth flow works and the per-app cap to set first.

Claude Code mods are plugins whose JavaScript handlers run inside Claude Code. What they do that hooks and skills cannot, a first mod, and the trust question.
Showing 145-156 of 1190 articles
Deep dives on AI agents, coding tools, and building with LLMs - delivered weekly. No spam.
Free forever. Unsubscribe anytime.

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.