Short Answer

Calculating RoPE Component Period

A large language model uses rotary positional embeddings with an embedding dimensionality of d = 128 and a base of b = 10000. Using the formula T_k = 2π * b^(2(k-1)/d), calculate the period for the component with index k = 33.

0

1

Updated 2025-10-03

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Application in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science