Designing a Reward Model for a Cooking Assistant
Given the scenario below, what specific information must be provided as input to the supervisory model to correctly classify the validity of the second step ('In a bowl, mix flour and sugar')? Additionally, what would be an appropriate set of output labels for this classification task?
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Scoring Reasoning Paths by Counting Correct Steps
Log-Probability-Based Reward for Reasoning Paths
Practical Benefits of Detailed Supervision for Long Reasoning Paths
An AI team is building a supervisory model to assess each step in a multi-step reasoning process. The model receives the initial problem and all preceding steps as input, and it must output a judgment on whether the current step is 'correct' or 'incorrect'. Given this objective, which architectural component is most appropriate for the model's final layer, and why?
Designing a Reward Model for a Cooking Assistant
When a process-based reward model is framed as a classification task, its primary function is to output a single, continuous score (e.g., from 0.0 to 1.0) that represents the quality of a given reasoning step.