Multiple Choice

An engineer is designing a large language model and is deciding on the architecture for its attention layers. The model is configured to have 64 query heads. The engineer uses an attention variant where these query heads are partitioned into groups, and all heads within a group share the same key and value projections. If the engineer sets the number of key-value groups to 1, which statement best analyzes the resulting configuration?

0

1

Updated 2025-09-26

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science