Learn Before
Formula

Vector Transformation Formula

The formula ki=ϕ(ki)\mathbf{k}'_i = \phi(\mathbf{k}_i) describes the transformation of an original vector ki\mathbf{k}_i into a new vector ki\mathbf{k}'_i by applying a transformation function or map ϕ\phi. In this formula, the bold notation indicates vector quantities, and the subscript ii denotes that the operation is performed on an individual element within a set or sequence of vectors. In the context of Large Language Models, this formula can represent the transformation of key vectors within an attention mechanism.

Image 0

0

1

Updated 2026-07-03

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Related