Learn Before
A company is developing a conversational AI for a customer service chatbot. User testing reveals that customers perceive the chatbot as 'slow' or 'unresponsive' primarily due to the noticeable pause between them sending a message and the chatbot starting to type its reply. To directly address this specific user perception issue, which efficiency metric should the engineering team focus on minimizing?
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Analyzing Chatbot Response Latency
A company is developing a conversational AI for a customer service chatbot. User testing reveals that customers perceive the chatbot as 'slow' or 'unresponsive' primarily due to the noticeable pause between them sending a message and the chatbot starting to type its reply. To directly address this specific user perception issue, which efficiency metric should the engineering team focus on minimizing?
A user reports that a chatbot application feels very responsive because it begins generating its answer almost instantly. Based on this observation alone, it is valid to conclude that the underlying language model is also highly efficient at generating long, multi-paragraph responses.