A machine learning engineer is building a system to classify the sentiment of customer reviews (e.g., positive, negative). They decide to use the internal representations from a pre-trained, multi-layered language model as features for their classifier. Which of the following model outputs would provide the most contextually-rich and effective representation of an entire review for this classification task?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Logits in Transformer Language Models
A language model processes the following two sentences independently:
- 'The river bank was steep and muddy.'
- 'He withdrew cash from the bank.'
Considering the final layer of the model, how would the output vector (the final hidden state) for the word 'bank' in the first sentence compare to the output vector for 'bank' in the second sentence?
A language model with multiple layers processes an input sequence to predict the next token. For a single token within that sequence, arrange the following representations in the chronological order they are computed by the model.
A machine learning engineer is building a system to classify the sentiment of customer reviews (e.g., positive, negative). They decide to use the internal representations from a pre-trained, multi-layered language model as features for their classifier. Which of the following model outputs would provide the most contextually-rich and effective representation of an entire review for this classification task?