Instruction Set Optimization for Real-Time Application
A development team is building a real-time translation feature for a mobile app. They have two options for their instructions:
- A highly detailed, multi-sentence instruction that specifies tone, style, and handling of idiomatic expressions.
- A very brief, single-sentence instruction that simply asks for a translation between two languages.
The team's highest priority is minimizing the delay (latency) for the end-user. Which instruction option should they choose? Justify your decision by explaining the effect of instruction complexity on the model's processing requirements.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A developer is creating an automated system to categorize thousands of incoming customer support tickets per hour into one of three categories: 'Technical Issue', 'Billing Inquiry', or 'General Feedback'. The primary constraint for the system is to minimize the computational cost and response time for each categorization. Which of the following instructions would be the most effective choice to meet this primary constraint?
Prompting Strategy for High-Volume Summarization
Instruction Set Optimization for Real-Time Application