Concept icon
Concept

Selective Filtering in Harness Learning

Selective filtering is the design principle stating that execution experience must be critically abstracted and filtered before being committed to persistent procedural memory. Unfiltered failure-driven adaptation risks three primary failure modes: overfitting to ambiguous task specifications by creating arbitrary default conventions, memorizing external evaluator quirks rather than genuine task contracts, and over-abstracting heavy, restrictive procedures that harm general performance across varied workflows. Harness scaling is fundamentally a problem of abstracting and protecting consequential execution boundaries rather than accumulating rules from every observed failure trace.

0

1

Concept icon
Updated 2026-09-21

Tags

Prep Sessions

Long-Horizon Agent Reliability: Stateful Scaffolding and Runtime Verification @ University of Michigan - Ann Arbor

Ch.3 State Persistence and Continuous Optimization - Long-Horizon Agent Reliability: Stateful Scaffolding and Runtime Verification @ University of Michigan - Ann Arbor

Failure-Driven Harness Optimization and Procedural Memory - Long-Horizon Agent Reliability: Stateful Scaffolding and Runtime Verification @ University of Michigan - Ann Arbor