Learn Before
A team is optimizing a language model for a real-time, streaming chatbot. They are focused on two distinct aspects of the user's perception of speed. Match each performance characteristic with the user experience it directly impacts.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A company is developing a real-time, interactive chatbot for customer support. The primary goal for user experience is that once the chatbot starts replying, the rest of its message appears to stream smoothly and continuously, creating a fluid conversational flow. The team is evaluating two different language models:
- Model Alpha: Responds almost instantly after the user sends a message, but each subsequent word appears with a noticeable, consistent pause.
- Model Beta: Takes a mom
LLM Performance Analysis for Code Completion
A team is optimizing a language model for a real-time, streaming chatbot. They are focused on two distinct aspects of the user's perception of speed. Match each performance characteristic with the user experience it directly impacts.