LLM INFRASTRUCTURE
2 items
2 posts
Blog
13.5 Million Copilot Sessions: What Production Coding Agent Traffic Actually Looks LikeCopilot traces from 3.2M users and 761M LLM calls: 87% of calls are agent-initiated, KV cache hits drop at turn boundaries, tool failures multiply compute.
Blog
Envoy AI Gateway 1.0 Makes LLM Routing an Infrastructure DecisionEnvoy AI Gateway 1.0 moves LLM routing into infrastructure. When an Envoy-based gateway beats direct SDK calls, LiteLLM, OpenRouter, or a hosted AI gateway.

Get Smarter About AI Dev
New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.
One email per weekReal code, not theoryFree forever