Learn Before
Effectiveness of Feedback Types
An LLM is tasked with writing a short story. In the critique stage, a verifier provides only a numerical score of '3 out of 10' as feedback. Analyze the primary limitation of this type of feedback for guiding the model's next attempt, and contrast it with the potential benefits of providing a textual critique instead.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An automated system is designed to iteratively improve a computer program for a complex data analysis task. The first version of the program runs but contains a subtle logical flaw that produces incorrect results for certain edge cases, and it also uses an inefficient sorting algorithm. To guide the system in generating a better second version, which of the following feedback approaches is most effective for promoting a substantial improvement?
Effectiveness of Feedback Types
An AI assistant was tasked with generating a three-paragraph summary of a complex research paper. The first draft was factually accurate but poorly organized and failed to highlight the paper's main conclusion. For the next iteration, a human verifier provides feedback to guide the model. Match each feedback mechanism below with the specific example of that feedback.