Learn Before
LLM Deployment Strategy for a Startup
A startup has access to a single, powerful, pre-trained language model. They want to launch two distinct products quickly: a 'Creative Co-Writer' that generates imaginative story ideas, and a 'Legal Brief Assistant' that produces formal, factually accurate summaries. The startup has a very limited budget and a tight deadline, making it impossible to fund extensive, separate training runs for each product.
Two engineers propose different strategies:
- Engineer A: Suggests creating two separate, fine-tuned versions of the model, one for each product, by continuing the training process with specialized datasets.
- Engineer B: Suggests using the single, original model for both products but controlling its output for each task by providing it with highly specific, detailed instructions and rules just before it generates a response.
Based on the startup's constraints, which engineer's strategy is more viable? Justify your reasoning by explaining the primary advantage of your chosen approach in this context.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.5 Inference - Foundations of Large Language Models
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Prompting as a Form of Inference-Time Alignment
Rescoring and Reranking for Inference-Time Alignment
A company deploys a large, pre-trained language model for its public-facing chatbot. Due to immense computational costs, they cannot alter the model's core programming or retrain it. To ensure the chatbot's responses are consistently helpful and harmless, they implement a new system. This system works by having the original model generate five different potential answers for every user query. A second, much smaller, specialized model then rapidly evaluates these five answers based on safety and helpfulness criteria, and only the highest-scoring answer is displayed to the user. Which principle does this company's strategy best illustrate?
Choosing an LLM Alignment Strategy
System Information in Prompts
LLM Deployment Strategy for a Startup