Learn Before
A transformation is applied to a d-dimensional vector at position using a set of frequencies . The transformation is defined by the following element-wise formula: where denotes element-wise multiplication.
Given the input vector , position , and frequencies , , what is the resulting vector ?
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Permuted Input Vector in RoPE
A transformation is applied to a d-dimensional vector at position using a set of frequencies . The transformation is defined by the following element-wise formula: where denotes element-wise multiplication.
Given the input vector , position , and frequencies , , what is the resulting vector ?
Analyzing Components of a Vector Transformation
Consider the element-wise formula for applying a rotational transformation to a d-dimensional vector . The formula involves summing two vectors derived from element-wise products.
True or False: The first vector in the sum is the product of the original input vector and a sine vector, and the second vector is the product of a permuted input vector (e.g., ) and a cosine vector.