Question: Discuss why splitting an AI system into (1) learning an approximate scoring function and (2) applying an approximate maximization algorithm to search for the best output is a valuable design pattern, and how this separation helps diagnose the Optimization Verification test.

Sample answer: Separating the system into a scoring function and a search algorithm lets engineers isolate where errors come from: if a known-good output y* scores higher than the algorithm's chosen output y under Score_x(.), the problem lies in the search/maximization algorithm; if y* scores lower or equal, the problem lies in the scoring function itself. This separation, as described in the speech recognition example, turns a single opaque system into two independently diagnosable components.

Key points:

• Scoring function estimates how good an output is for a given input
• Search/maximization algorithm finds the output that maximizes the score
• Separation allows independent diagnosis of each component
• Optimization Verification test compares scores of a correct output vs. the algorithm's output
• Determines whether errors stem from the scoring function or the search algorithm

Rubric: Full credit for explaining that the pattern separates scoring from search, that this enables the Optimization Verification test, and that comparing scores of known-good vs. algorithm outputs isolates whether the scoring function or the search algorithm is at fault.