Learn Before
Formula for Selecting the Best Candidate via a Verifier
The selection of the best candidate, , from a set of candidates is achieved by identifying the candidate that maximizes the score of a verifier function, . This process is formally expressed using the argmax operator:

0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Formula for Selecting the Best Candidate via a Verifier
Selecting the Best Model-Generated Text
An automated system is tasked with summarizing a news article. It generates four different candidate summaries. A separate component then evaluates each summary for factual accuracy and coherence, assigning a quality score from 1 (poor) to 10 (excellent). The scores are as follows:
- Summary A: 7
- Summary B: 9
- Summary C: 4
- Summary D: 8
Based on a process where the highest-scoring candidate is selected, which summary will be chosen as the final output?
An automated system uses a scoring function to select the best response from a set of generated options. Arrange the following steps into the correct logical sequence.
Learn After
A system generates a set of four candidate responses (
y) to a user's query. A scoring function,V(y), evaluates each response and assigns it a score from 0 to 1, where a higher score indicates a better response.Candidate Response Score V(y)Response A 0.78 Response B 0.91 Response C 0.65 Response D 0.89 Given the selection formula
ŷ = argmax(y ∈ Dc) V(y), whereDcis the set of all candidate responses, which response would be selected as the best candidate,ŷ?A system for generating creative story endings uses the formula to select the best ending from a set of candidates. The verifier function, , is designed to score endings based solely on their grammatical correctness. The system consistently selects endings that are grammatically perfect but are reported by users as being dull and unoriginal. What is the most likely reason for this suboptimal outcome?
Evaluating Verifier Function Design