Learn Before
In a model using rotary positional embeddings, if the token embedding dimensionality is represented by d, the parameter vector θ that determines the rotational frequencies will contain ____ distinct parameters.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Recall in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A large language model is designed with token embeddings that have a dimensionality of 512. If this model uses rotary positional embeddings, how many distinct parameters must be defined in the vector that determines the rotational frequencies?
For a transformer model utilizing rotary positional embeddings with a token embedding dimensionality of
d, the parameter vectorθthat defines the rotational frequencies consists ofddistinct parameters.In a model using rotary positional embeddings, if the token embedding dimensionality is represented by
d, the parameter vectorθthat determines the rotational frequencies will contain ____ distinct parameters.