Learn Before
Majority Voting as a Verification Heuristic
Majority voting is a common heuristic-based verification technique. It operates by selecting the answer that appears most frequently within a collection of generated candidate solutions.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Majority Voting as a Verification Heuristic
A system is designed to answer simple factual questions. For any given question, it generates a list of five potential answers. The system must then choose the best final answer from this list. Which of the following methods for choosing the final answer relies on a simple, predefined rule rather than on complex patterns learned from a large dataset?
Choosing a Solution-Checking Method
A system designed to solve math problems generates multiple final answers. To select the best one, it uses a verifier that simply checks which answer is most frequently generated. This type of verifier is considered a complex, data-driven model because its selection is determined by the data (the generated answers).
Learn After
Selecting a Final Answer from Multiple Candidates
An automated system generates a set of five candidate answers to the question, 'What is the primary gas in Earth's atmosphere?'. The candidate answers are: ['Nitrogen', 'Oxygen', 'Nitrogen', 'Argon', 'Nitrogen']. If the system is designed to select the final answer based on which one appears most frequently in the set, what will its final output be?
An automated system generates five candidate answers for a complex question. The system uses a verification method that selects the answer appearing most frequently. In which of the following situations is this method most likely to select an incorrect final answer?