Learn Before
A user provides the input 'Summarize this article', which a language model processes into three distinct tokens ('Summarize', 'this', 'article'). Based on the formal structure where an input sequence is represented by its tokens plus a special start symbol, what is the total number of tokens in the complete sequence given to the model?
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.2 Generative Models - Foundations of Large Language Models
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Start of Sequence (SOS) Token
Formal Definition of LLM Inference
A language model receives an input prompt that is tokenized into 10 tokens. According to the formal representation of an input sequence, , which of the following correctly describes the structure of the complete sequence processed by the model?
A language model is given the complete input token sequence: . By analyzing the components of this sequence, identify which token's primary role is to signal the beginning of the input context for the model.
Related
Start of Sequence (SOS) Token
Formal Definition of LLM Inference
A language model receives an input prompt that is tokenized into 10 tokens. According to the formal representation of an input sequence, , which of the following correctly describes the structure of the complete sequence processed by the model?
A language model is given the complete input token sequence: . By analyzing the components of this sequence, identify which token's primary role is to signal the beginning of the input context for the model.