Definition

Definition of C(x, tθ) Notation for Rotated Tokens

In the context of Rotary Positional Embeddings (RoPE), the notation C(x,tθ)C(\mathbf{x}, t\theta) is used as a shorthand to represent a token's embedding x\mathbf{x} after it has been rotated by an angle tθt\theta. This notation encapsulates the result of the complex multiplication xeitθx'e^{it\theta}, where xx' is the complex number form of the vector x\mathbf{x}.

0

1

Updated 2026-04-29

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences