Multiple Choice

In a grouped-query attention system with 12 query heads (indexed j=1 to 12), the function g(j) maps a query head j to its corresponding key-value group. This mapping is defined by the formula g(j) = floor((j-1) / 3) + 1. Based on this, which of the following pairs of query heads will use the same set of Key and Value matrices for their attention computation?

0

1

Updated 2025-10-04

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science