Analyzing the Trade-offs of a Multi-Output Chatbot Strategy
A startup is developing a customer support chatbot. To improve the quality of its responses, the engineering team suggests a new approach: for every user query, the model will generate five different potential answers, and a separate mechanism will select the best one to show the user. Describe two distinct practical costs or challenges this new approach would introduce compared to simply generating a single answer.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Diminishing Returns in Output Ensembling
A financial services company is developing a system to provide real-time fraud alerts. The system uses a language model to analyze transaction descriptions. To maximize accuracy, the engineering team proposes a strategy: for each transaction, the model will generate ten different analytical summaries. A secondary process will then review all ten summaries to produce a final, highly reliable alert decision. Given the system's purpose, which of the following represents the most critical judgment the team must make about this strategy?
Evaluating a Multi-Output Generation Strategy
Analyzing the Trade-offs of a Multi-Output Chatbot Strategy
Evaluating a Multi-Output Strategy for a Real-Time Chatbot