Activity (Process)

Failure-Driven Harness Optimization

Failure-driven harness optimization is an iterative development process that systematically converts postmortem findings from agent execution failures into versioned runtime controls without modifying underlying model weights. Following a failed run, defects are categorized into operational causes—such as missing context, invalid transitions, weak verification checks, premature handoffs, or ineffective recovery. The executing agent or a supervisory hyper-agent then proposes targeted modifications to state boundaries, prompts, entry/exit hooks, pre-commit checks, recovery rules, and practice activation criteria. Proposed changes are reviewed, regression-tested against existing tasks, and merged into a new versioned runbook.

0

1

Updated 2026-09-21

Tags

Prep Sessions

Long-Horizon Agent Reliability: Stateful Scaffolding and Runtime Verification @ University of Michigan - Ann Arbor

Ch.3 State Persistence and Continuous Optimization - Long-Horizon Agent Reliability: Stateful Scaffolding and Runtime Verification @ University of Michigan - Ann Arbor

Failure-Driven Harness Optimization and Procedural Memory - Long-Horizon Agent Reliability: Stateful Scaffolding and Runtime Verification @ University of Michigan - Ann Arbor