Agents
An agent workflow where one LLM call writes a response and a second call checks it against explicit criteria and sends back feedback.
An agent workflow where one LLM call writes a response and a second call checks it against explicit criteria and sends back feedback. The two repeat until the output passes or a stop condition is hit. Anthropic lists it as a core agentic workflow and says it works best when the evaluation criteria are clear, as in literary translation where a critic catches nuances the first draft missed. Unlike self-reflection, the critic is a separate prompt or model, and a maximum iteration count stops the loop from running forever.
Primary source: anthropic.com
Example
Unlike self-reflection, the critic is a separate prompt or model, and a maximum iteration count stops the loop from running forever.
Hands-on guides, comparisons, and tutorials that cover Agents.
FAQ
An agent workflow where one LLM call writes a response and a second call checks it against explicit criteria and sends back feedback.
Evaluator-Optimizer sits in the Agents part of the AI stack. Understanding it helps you make better decisions when building, debugging, and shipping AI features.
Developers Digest publishes tutorials and videos that cover Agents topics including Evaluator-Optimizer. Check the blog and YouTube channel for hands-on walkthroughs.
Related
The infrastructure that runs evals end to end: it feeds tasks to the model or agent, records every step, applies graders, and aggregates the results into scores.
A multi-agent mechanism where one agent passes control of the conversation to a more specialized agent, rather than calling it as a subroutine.
A technique where an AI agent evaluates its own output before returning it to the user.

New tutorials, open-source projects, and deep dives on coding agents - delivered weekly.