Learn Before
Distinguishing Sequence-Level vs. Element-Level Functions
Consider two different functional approaches for processing a sequence of vectors .
Approach A uses a function which takes the entire sequence as input and produces a single output.
Approach B applies a function to each vector individually, producing a sequence of outputs: .
Explain the fundamental difference in the type of information these two approaches can capture from the input sequence.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A model is tasked with classifying the sentiment of a sentence as either 'positive' or 'negative'. It first represents each of the
nwords in the sentence as a vector. Then, a specific component of the model takes the entire sequence of thesenword vectors as input and computes a single, final sentiment score. Which notation best describes the action of this specific component?Distinguishing Sequence-Level vs. Element-Level Functions
Applicability of Sequence-Level Functions