Learn Before
Justification for Hypothesis Simplification
During the search process for generating a response from a large language model for a single, fixed input, a 'hypothesis' is often defined simply as a potential output sequence, rather than a pair containing both the input and the output sequence. Justify this simplification, explaining why it is a valid and practical approach in this specific context.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Search Space in LLM Inference
An LLM is tasked with completing the input sequence
x = 'The best way to learn a new skill is'. During the inference process, a search algorithm considers several potential continuations, such asy1 = 'to practice consistently',y2 = 'by reading a book', andy3 = 'through immersive experience'. How are these potential continuations best described within the context of the search problem?Justification for Hypothesis Simplification
During language model inference, a 'hypothesis' refers exclusively to a potential output sequence, and the input sequence is not considered part of its formal definition.