Learn Before
Example of the Self-Consistency Method
To illustrate the self-consistency method, consider a language model prompted with a Chain-of-Thought query to find the probability of exactly one head in three coin flips. The model generates three reasoning paths via sampling. Prediction 1 calculates a probability of using basic principles. Prediction 2 correctly applies the binomial probability formula, also arriving at . Prediction 3 incorrectly concludes the probability is . Although the reasoning paths for the first two predictions are different, they converge on the same final answer of . By counting the frequencies of the final answers, has the highest count (two out of three) and is selected as the final output.
0
1
Tags
Foundations of Large Language Models
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences