Evaluating a Model Adaptation Strategy
A company plans to adapt a pre-trained language model for two distinct applications using the same method: creating a large dataset of example inputs and their corresponding ideal outputs to adjust the model's parameters.
- Application 1: A tool that converts natural language queries (e.g., "show me last month's sales in the northeast region") into precisely formatted database query code.
- Application 2: A creative partner designed to generate original, emotionally resonant poetry based on a single-word prompt (e.g., "solitude").
Critique the company's plan. For which application is this adaptation method more likely to yield reliable and high-quality results? Justify your reasoning based on the nature of the tasks themselves.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.2 Generative Models - Foundations of Large Language Models
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A development team wants to adapt a pre-trained language model for a specific business need. Their plan is to create a dataset of several thousand examples, where each example consists of a clear directive and the exact, desired output. They will then use this dataset to adjust the model's parameters. Which of the following use cases is most likely to succeed with this adaptation method?
Evaluating a Model Adaptation Strategy
A team is adapting a pre-trained language model by fine-tuning it on a dataset of instructions and their corresponding 'correct' outputs. Match each task below with the statement that best describes its suitability for this adaptation method.