Definition of C(x, tθ) Notation for Rotated Tokens
In the context of Rotary Positional Embeddings (RoPE), the notation is used as a shorthand to represent a token's embedding after it has been rotated by an angle . This notation encapsulates the result of the complex multiplication , where is the complex number form of the vector .
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Formula for Applying RoPE Rotation 't' Times
Definition of C(x, tθ) Notation for Rotated Tokens
Component-wise Vector Rotation in Complex Space
A 2D vector (x, y) can be represented by the complex number z = x + iy. To rotate this vector by an angle θ, it is multiplied by the complex number e^(iθ) = cos(θ) + i sin(θ). If the vector (3, 4) is rotated by 90 degrees (π/2 radians) using this method, what are the coordinates of the new, rotated vector?
A 2D vector can be rotated by representing it as a complex number and multiplying it by another complex number that represents the rotation. Arrange the following steps in the correct logical order to derive the coordinates of a vector
(x₁, x₂)after it has been rotated by an angleθ.Mapping Complex Multiplication to Rotated Vector Components
Learn After
Inner Product of RoPE-Encoded Token Representations
In the context of positional embeddings, the notation represents the result of rotating a 2-dimensional vector by an angle . If the initial vector is and the rotation angle is , what is the resulting vector?
The notation is a shorthand for rotating a 2-dimensional vector by an angle . This operation is equivalent to representing the vector as a complex number and multiplying it by . Based on this, which expression correctly represents the first component of the resulting rotated vector?
The transformation represented by the notation , which rotates a 2-dimensional vector by an angle , changes the magnitude (or length) of the original vector .