Learn Before
Analyzing Search Space Dimensions
Consider two different tasks for a language model. Analyze the two scenarios below to determine which one involves a larger set of all possible unique output sequences (i.e., a larger search space). Justify your reasoning by explaining the relationship between the number of available tokens, the maximum output length, and the total size of the possibility space.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Formula for the Search Space as a Union of Complete Sequences
Formula for the Expansion of the Search Space at Each Step
A simplified language model has a vocabulary consisting of only three unique tokens: 'cat', 'sat', and 'on'. The model is configured to generate an output sequence with a fixed length of exactly two tokens. Which of the following options correctly represents the complete set of all possible output sequences the model can generate?
Analyzing Search Space Dimensions
Growth of the Generative Search Space
Mathematical Formulation of the Search Problem in LLM Inference