Learn Before
Evaluating a Risk Function for Legal Translation
A team is developing a translation system for legal documents where precision is paramount. Given the proposed risk function in the case study below, critically evaluate its suitability for this task. Identify its primary limitation and describe a key characteristic that a more appropriate risk function should possess.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Risk of an Output in Minimum Bayes Risk Decoding
A language model is generating a summary for a document. The ideal, human-written reference summary is
yr: "The study found a significant link between diet and health."The model considers two candidate summaries:
y1: "The study found a significant link between diet and health."y2: "Research showed a connection between food and wellness."
Given the purpose of a risk function,
R(candidate, reference), which of the following statements best describes how it would operate in this scenario?Evaluating a Simple Risk Function
Evaluating a Risk Function for Legal Translation