Learn Before
What does self-attention compute for an input sequence?
0
1
Tags
Prep Sessions
Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Ch.1 Transformer Architecture Fundamentals - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Self-Attention and Query-Key-Value Mechanisms - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Related
Which of the following is another name for self-attention?
True or False: Self-attention operates by connecting positions across two or more separate input sequences.
Consider how self-attention processes an ambiguous word in a sentence, such as 'bank' in the phrase 'river bank'. Explain how the mechanism uses the sentence to determine the contextual meaning of that word.
Related
Which of the following is another name for self-attention?
True or False: Self-attention operates by connecting positions across two or more separate input sequences.
Consider how self-attention processes an ambiguous word in a sentence, such as 'bank' in the phrase 'river bank'. Explain how the mechanism uses the sentence to determine the contextual meaning of that word.