Learn Before
Example of Indexed Embedding Sequence Notation
A sequence of embedding vectors, indexed from a starting point to an ending point , is represented as: . This notation serves as a specific application of indexed sequence representation for embedding vectors within sequence models.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Example of Indexed Embedding Sequence Notation
Example of Indexed Hidden State Sequence Notation
A model processes a sequence of seven input vectors, represented as . Which of the following correctly uses indexed notation to represent the subsequence containing only the third, fourth, and fifth vectors?
Applying Indexed Sequence Notation
A sequence of vectors is represented by the notation . This notation represents a subsequence containing exactly 6 vectors.
Learn After
A model processes the sentence 'The quick brown fox jumps'. The sentence is tokenized, and each token is converted into a corresponding vector. The tokens are indexed starting from 1, so 'The' corresponds to index 1, 'quick' to index 2, and so on. Using the standard notation for a sequence of these vectors, how would you represent the vectors for the subsequence 'quick brown fox'?
Consider the sentence 'Large language models are powerful tools', where the words are indexed starting from 1. The notation
e_3, e_4, e_5represents the sequence of embedding vectors for the words 'models are powerful'.Representing a Subsequence with Embedding Notation