Learn Before
Example of Indexed Hidden State Sequence Notation
A sequence of hidden states, indexed from an initial point to a final point , can be represented as a series of vectors: . This notation is commonly used in sequence models to denote a specific subsequence of hidden state vectors.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Example of Indexed Embedding Sequence Notation
Example of Indexed Hidden State Sequence Notation
A model processes a sequence of seven input vectors, represented as . Which of the following correctly uses indexed notation to represent the subsequence containing only the third, fourth, and fifth vectors?
Applying Indexed Sequence Notation
A sequence of vectors is represented by the notation . This notation represents a subsequence containing exactly 6 vectors.
Learn After
A sequence model processes the sentence 'The quick brown fox jumps over' and generates a hidden state vector for each word. The vectors are indexed starting from 1, so the vector for 'The' is represented as (\mathbf{h}_1), for 'quick' as (\mathbf{h}_2), and so on. Which of the following correctly represents the sequence of hidden state vectors for the specific phrase 'brown fox jumps'?
Representing a Subsequence of Hidden States
A sequence of hidden state vectors is represented as . This sequence contains a total of ____ vectors.