Learn Before
Evaluating a Prompting Strategy for Different Model Tiers
A software development team has created a set of simple, one-sentence prompts for a customer service chatbot. They are now deciding which language model to use for their application. Option A is a large, highly capable, but expensive commercial model. Option B is a smaller, less powerful, but more cost-effective open-source model.
Critique the team's strategy of using the same set of simple prompts for both potential models. What is the likely outcome for each option, and what adjustments, if any, would you recommend to the team if they choose Option B? Justify your reasoning.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An engineer provides the same simple, one-sentence instruction, 'Summarize the attached text,' to two different language models, Model X and Model Y. Model X returns a coherent, accurate summary. Model Y returns a list of disconnected sentences extracted verbatim from the original text. Based solely on this outcome, what is the most logical analysis of the situation?
Improving Prompt Performance for a Less Capable Model
Evaluating a Prompting Strategy for Different Model Tiers