Learn Before
Prioritizing Performance Metrics for a New Application
A technology startup is developing a new mobile application that provides real-time language translation for travelers. The key business goals are to ensure the app is highly responsive, functions well on a wide variety of smartphones without draining the battery, and can be used by people with limited data plans. While the quality of translation is important, the company has decided that conveying the essential meaning quickly is more critical for user satisfaction than achieving perfect grammatical structure.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Efficiency Metrics for LLM Evaluation
Comprehensive LLM Evaluation Framework
Quality-Focused Evaluation Metrics for LLMs
Prioritizing Performance Metrics for a New Application
A team is evaluating a new Large Language Model for various applications. Match each evaluation goal with the primary performance standard it assesses.
A startup is developing a new Large Language Model for a live, real-time voice translation application to be used at an international conference. Their primary constraints are a strict budget for computational resources and the need for near-instantaneous translation. Which of the following describes the most critical evaluation trade-off the team must navigate when choosing a model?