Multiple Choice

A developer is adapting a pre-trained language model that uses rotational position embeddings to handle much longer input sequences. They achieve this by applying a scaling factor to the base b used in the frequency calculations for the embeddings. Which statement best analyzes the impact of this change on the periods of the rotational frequencies across the different embedding dimensions?

0

1

Updated 2025-10-01

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science