Formula

Vector Transformation Function (ki=ϕ(ki)\mathbf{k}'_i = \phi(\mathbf{k}_i))

This formula describes a transformation where a vector, denoted as ki\mathbf{k}_i, is mapped to a new vector, ki\mathbf{k}'_i, by applying a function ϕ\phi. The bold notation indicates these are vector quantities. The subscript ii suggests this operation is performed on an individual element within a set or sequence of vectors. In the context of Large Language Models, this can represent the transformation of key vectors within an attention mechanism.

Image 0

0

1

Updated 2025-10-08

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences