BATCH-API
2 items
2 posts
Blog
How to Cut Your LLM API Bill in 2026: Prompt Caching, Batch and Flex Tiers Compared Across 15 ProvidersCaching a shared prompt cut our worked example by about 78-80% on four models; batch takes 50% off at most providers but 40% at Moonshot and 20% at xAI. Only Anthropic, Fireworks and xAI say the two stack. The math, the assumptions and the quotes.
Blog
Claude Batch API: Cutting Async Workload Costs In HalfHow to ship Claude's Batch API in production. 50% cost savings, TypeScript SDK code, JSONL request format, and the async architecture gotchas that bite at 100k requests.

Get Smarter About AI Dev
New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.
One email per weekReal code, not theoryFree forever