Learn Before
Critique of an Annotation Strategy
A data annotation team is tasked with improving a language model's ability to generate complex, multi-step mathematical proofs. The project manager instructs the team to prioritize identifying and labeling every instance of simple arithmetic mistakes (e.g., 2+2=5) in the model's generated steps. Explain why this is likely an inefficient strategy for achieving the team's primary goal.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team is training a language model to solve complex, multi-step word problems by having human annotators review and correct the model's step-by-step reasoning. Given a limited budget for annotation, which of the following strategies would be the most effective for improving the model's core reasoning abilities?
Evaluating an Annotation Strategy for an AI Tutor
Critique of an Annotation Strategy