Multiple Choice

A researcher proposes a modified rotational transformation for encoding token positions, defined as ei=Ro(iθ)e'_i = \text{Ro}(i\theta), where ii is the position and θ\theta is a parameter. This new embedding eie'_i is intended to replace the standard formulation ei=Ro(xi,iθ)e_i = \text{Ro}(x_i, i\theta), where xix_i is the original token embedding. What is the primary conceptual flaw of using eie'_i as the final token representation in a sequence?

0

1

Updated 2025-10-03

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science