A diagram illustrates a single step in an iterative process for enhancing a model's input vectors. In this step, the vectors from the previous iteration (denoted as σᵢ) are combined with standard input embeddings (eᵢ) and processed by the model's main layers to produce hidden states (hᵢ). These hidden states are then used to calculate the enhanced vectors for the next iteration (σᵢ₊₁). Which part of this flow most directly embodies the 'refinement' that occurs in each step?
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A technique for improving a model's performance involves iteratively refining a set of special input vectors. The following items describe the stages within a single step of this refinement process. Arrange these stages in the correct logical order, from the initial inputs to the final output of one complete step.
A diagram illustrates a single step in an iterative process for enhancing a model's input vectors. In this step, the vectors from the previous iteration (denoted as σᵢ) are combined with standard input embeddings (eᵢ) and processed by the model's main layers to produce hidden states (hᵢ). These hidden states are then used to calculate the enhanced vectors for the next iteration (σᵢ₊₁). Which part of this flow most directly embodies the 'refinement' that occurs in each step?
Component Relationships in an Iterative Refinement Diagram