You are tasked with evaluating a new prompt designed to make a language model summarize news articles. You have a dataset of 50 news articles, each with a corresponding human-written 'gold standard' summary. Arrange the following actions into the correct sequence to estimate the performance of your new prompt.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team is developing a system to classify customer feedback emails as 'Urgent' or 'Not Urgent'. They have designed two different sets of instructions for the language model to follow. To decide which set of instructions is more effective, what is the most appropriate next step?
You are tasked with evaluating a new prompt designed to make a language model summarize news articles. You have a dataset of 50 news articles, each with a corresponding human-written 'gold standard' summary. Arrange the following actions into the correct sequence to estimate the performance of your new prompt.
Discrepancy in Prompt Performance