Learn Before
Diagnosing Flawed Reasoning in Language Models
Analyze the provided case study. Which type of supervisory signal—one that evaluates only the final outcome or one that evaluates each intermediate step of the reasoning process—would be more effective at identifying and correcting the model's flawed reasoning? Explain why the chosen approach would succeed and the other would likely fail in this specific scenario.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Diagnosing Flawed Reasoning in Language Models
A team is training a language model to act as a programming assistant that generates code. They observe that the model sometimes produces functionally correct code (the outcome is right) but uses inefficient, non-standard, or difficult-to-maintain methods (the process is poor). Which of the following feedback strategies would be most effective at specifically improving the quality of the reasoning process, rather than just the correctness of the final output?
A research team is developing a large language model for different tasks. Match each training objective with the most appropriate feedback strategy.
Comparing Outcome-Based and Process-Based Evaluations of Math Responses