Discrepancy in Prompt Performance
Based on the principles of performance estimation, what is the most likely reason for the significant difference between the model's performance on the validation set and its performance in the real-world application? Explain your reasoning.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team is developing a system to classify customer feedback emails as 'Urgent' or 'Not Urgent'. They have designed two different sets of instructions for the language model to follow. To decide which set of instructions is more effective, what is the most appropriate next step?
You are tasked with evaluating a new prompt designed to make a language model summarize news articles. You have a dataset of 50 news articles, each with a corresponding human-written 'gold standard' summary. Arrange the following actions into the correct sequence to estimate the performance of your new prompt.
Discrepancy in Prompt Performance