Adapting a Soft-Prompt-Tuned Model
A company uses a large language model fine-tuned with a soft prompt to classify support tickets into five specific categories. This system is highly efficient in production. The company now needs to add a sixth, urgent category. Analyze the primary challenge the company will face in adapting their current system, based on the inherent properties of the prompting method used.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A startup is developing an AI-powered chatbot for a rapidly evolving mobile game. The game receives updates with new characters and rules every two weeks, and the chatbot must be able to answer questions about these new additions almost immediately after they are released. The development team has limited computational resources for frequent, large-scale model training. They are considering a prompting method where the prompts are not human-readable text but are instead learnable vectors of numbers that are optimized directly through backpropagation. Given the requirements, which statement best evaluates the suitability of this prompting method for their project?
Evaluating a Prompting Method for Business Applications
Adapting a Soft-Prompt-Tuned Model