Learn Before
Euclidean Representation of RoPE Transformation
The Rotary Position Embedding (RoPE) transformation can be represented in d-dimensional Euclidean space using the formula: In this equation, a d-dimensional vector is transformed by multiplying it with a block-diagonal matrix. This matrix consists of individual 2x2 rotation matrices, , along its diagonal. This structure effectively pairs up the components of (e.g., with , with , etc.) and applies a separate 2D rotation to each pair.

0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Consider an original 2-dimensional vector represented as . If a transformation function, denoted by , is defined as multiplying the first element of an input vector by 2 and adding 1 to the second element, what is the resulting transformed vector after applying the formula ?
Vector Transformation Function ()
Euclidean Representation of RoPE Transformation
Identifying Components of a Vector Transformation
Match each component of the vector transformation formula with its correct description.
Learn After
A 6-dimensional vector is transformed by multiplying it with a block-diagonal matrix. This matrix is composed of three separate 2x2 rotation matrices placed along its diagonal, with all other elements being zero. Based on this structure, what is the relationship between the transformation applied to the first two components of the vector and the transformation applied to the last two components?
Applying a Block-Diagonal Transformation
Inferring a Transformation Matrix