
ORCA-bench: Frontier Agents Score 10% on Hard Oncall RCA
ORCA-bench puts five frontier coding agents on live oncall root cause analysis with real telemetry. The best scored 10% on hard tasks, far from oncall-ready.
424 articles - page 16 of 36

ORCA-bench puts five frontier coding agents on live oncall root cause analysis with real telemetry. The best scored 10% on hard tasks, far from oncall-ready.

OwlPath encodes code into an OWL2 ontology so coding agents can answer multi-hop structural queries with SPARQL, cutting tokens 28.8% on SWE-bench Pro.

PAIChecker finds 13.6% of SWE-bench Verified instances pair a PR with an issue it does not resolve, penalizing agents that solve the stated problem.

Shopify Hydrogen developer preview adds Vue bindings, bundled GraphQL TypeScript tooling, Shopify Inbox AI chat and new agent skills, plus breaking changes.

SIGIL compiles prose SKILL.md files into typed agent harnesses. Prose runs execute 56% of mandated steps; compiled harnesses reach 86% with 0.58x the tokens.

SWE-NFI benchmarks coding agents on 188 behavior-preserving improvement tasks. The best hits 70% correctness, but all lag humans on structural refactors.

What happens when AI tokens are too cheap to meter: five scenarios for developers and knowledge work, each with the signal that tells you it is arriving.

What if AI was free tomorrow at today's capabilities? A thought experiment on what changes for developers when price hits zero, and what stays scarce.

GPT-5.6 Luna drops 80% to $0.20/$1.20 per million tokens and Terra 20% to $2/$12. The cost-per-task math for agent builders, Codex quotas and rivals.

MCP Apps vs tool calling vs standalone web UIs: how sandboxed interactive UIs for MCP servers compare to the other two, and when to use each approach.

Wiki skills add the missing graph layer to agent context: skills that link to each other let agents navigate knowledge instead of front-loading it all.

AI coding agent firewalls compared: Belay, Claude Code hooks, Codex CLI sandboxes and MCP proxies vs destructive commands, secret leaks and prompt injection.
Showing 181-192 of 423 articles

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.
Explore 841 topics
Browse All Topics