Learn Before
Set of Superscript-Indexed Vectors ()
The notation represents a set of vectors. Each vector, denoted by , is further identified by a superscript index enclosed in square brackets, such as or . This indexing scheme is commonly used to represent a collection of vectors associated with a single element across multiple parallel contexts, for instance, the query vectors for the -th token across attention heads.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
General Formula for a Parameterized Function
A machine learning model is designed to predict a property's value based on four input features: square footage, number of bedrooms, age of the building, and lot size. Using the standard convention for representing a finite set of indexed variables, how would this set of inputs be denoted?
A function is designed to process a set of inputs represented by the notation . Based on this notation, the function takes a total of ______ input variables.
In the standard notation for a finite set of indexed variables, , the letter
mrepresents the total number of variables in the set.Set of Superscript-Indexed Vectors ()
Learn After
A computational model analyzes the 4th element in a sequence. To do this, it generates 12 distinct 'probe' vectors for this single element, one for each of its 12 parallel processing modules. Which of the following notations correctly represents the complete set of all 'probe' vectors for the 4th element?
True or False: In the notation { \mathbf{q}{i}^{[1]}, \dots, \mathbf{q}{i}^{[ au]} }, the subscript
irepresents one of\tauparallel contexts, while the superscript (e.g.,[1]) refers to a specific element in a sequence.