Learn Before
Analyzing Components of a Vector Transformation
A transformation is applied to a d-dimensional vector at position using a set of frequencies . The full transformation is defined by the following element-wise formula: Now, consider a simplified version of this transformation where the second term (involving the sine vector) is removed: Analyze the effect of this simplification. What geometric property of the full transformation is lost in the simple version, and what operation does the simple version perform instead?
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Permuted Input Vector in RoPE
A transformation is applied to a d-dimensional vector at position using a set of frequencies . The transformation is defined by the following element-wise formula: where denotes element-wise multiplication.
Given the input vector , position , and frequencies , , what is the resulting vector ?
Analyzing Components of a Vector Transformation
Consider the element-wise formula for applying a rotational transformation to a d-dimensional vector . The formula involves summing two vectors derived from element-wise products.
True or False: The first vector in the sum is the product of the original input vector and a sine vector, and the second vector is the product of a permuted input vector (e.g., ) and a cosine vector.