Learn Before
Expansion Stage in K-Best Selection
The expansion stage is the initial step in the K-best selection process. In this phase, a language model generates a set of potential next tokens or words based on the current context. For example, as depicted in the diagram labeled 'â‘ Expansion', given the token 'is', the model might produce a list of candidate words such as '.', 'cute', 'on', 'are', and 'sick'. These candidates are then passed to the subsequent ranking stage.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Example of K-Best Selection with a Beam Width of 3
Ranking Stage in Beam Search
Expansion Stage in K-Best Selection
A language model generates the following potential next words and their corresponding probabilities: 'house' (0.25), 'car' (0.40), 'boat' (0.15), 'plane' (0.18), and 'train' (0.02). If a selection process is used to keep only the top 3 most probable words, which set of words will be chosen?
A language model is generating the next word in a sentence. Arrange the following actions into the correct sequence for selecting the most promising candidates.
Ranking Stage in K-Best Selection
Output Stage in K-Best Selection
Impact of Selection Parameter on Text Generation
Learn After
A language model is generating a sentence and has so far produced the sequence: 'The sun is shining and the birds are...'. In the first phase of determining the next word, the model generates a list of potential candidates from its vocabulary based on the preceding text. Which of the following options best illustrates the direct output of this initial generation phase, before any sorting or filtering occurs?
When a language model generates the next word in a sentence, it follows a multi-step process to select the most promising options. Arrange the following three actions into the correct logical sequence.
Identifying the Generation Stage