A user gives a language model the following instruction and text:
Instruction: 'Summarize the following text in exactly one sentence.'
Text: 'The sun is a star at the center of our solar system. It is a nearly perfect sphere of hot plasma, with internal convective motion that generates a magnetic field. Its diameter is about 109 times that of Earth, and its mass accounts for about 99.86% of the total mass of the solar system.'
The model produces this output:
Output: 'The sun is the central star of our solar system. It is a massive sphere of hot plasma that generates a magnetic field. It is significantly larger and more massive than Earth.'
Which of the following statements best evaluates the model's performance?
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A user gives a language model the following instruction and text:
Instruction: 'Summarize the following text in exactly one sentence.'
Text: 'The sun is a star at the center of our solar system. It is a nearly perfect sphere of hot plasma, with internal convective motion that generates a magnetic field. Its diameter is about 109 times that of Earth, and its mass accounts for about 99.86% of the total mass of the solar system.'
The model produces this output:
Output: 'The sun is the central star of our solar system. It is a massive sphere of hot plasma that generates a magnetic field. It is significantly larger and more massive than Earth.'
Which of the following statements best evaluates the model's performance?
Applying a Length Constraint to a Prompt
Refining a Summarization Prompt