Learn Before
Reward Model Implementation Debugging
Based on the standard architecture for this type of system, what specific component is the engineer most likely missing in their implementation that would convert the final hidden state vector into a single scalar score, and what is its function?
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An engineer is building a system to generate a single quality score for a model's text response based on an initial prompt. Their proposed process is as follows:
- Concatenate the prompt tokens and the response tokens into a single sequence.
- Feed this combined sequence into a language model to get a final-layer hidden state vector for every token.
- Average all of these hidden state vectors to create a single representative vector.
- Pass this single vector through a linear layer to produce the final scalar score.
Which statement best identifies a critical flaw in this proposed method for this specific task?
You are tasked with designing a system that uses a language model to generate a single numerical score representing the quality of a given text response to a prompt. Arrange the following steps into the correct logical sequence for this process.
Reward Model Implementation Debugging