Learn Before
Analyzing a Segmentation Strategy for Code Evaluation
A team is building a system to have human experts rate the quality of computer code generated by an AI. To manage the review process, they decide to automatically break any generated code into segments of exactly 15 lines each. Explain the most significant conceptual flaw in this segmentation strategy and why it could lead to inaccurate quality ratings.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team is developing a reward model to assess the quality of multi-paragraph essays. To do this, they segment each essay into non-overlapping chunks of exactly 150 words for human evaluation. Which of the following describes the most significant weakness inherent in this specific segmentation strategy?
Evaluating Segmentation Strategy Suitability
Analyzing a Segmentation Strategy for Code Evaluation