Multiple Choice

An engineer is implementing a transformer model with an embedding dimensionality of d = 512. For the positional information, they use a method where frequency parameters θ_k are calculated using the formula: θ_k = 10000^(-2(k-1)/d). What is the correct value for the frequency parameter θ_k where the component index is k = 129?

0

1

Updated 2025-09-28

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Application in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science