LLM Deployment Strategy Evaluation
Based on the following scenario, evaluate the two proposed deployment strategies. Which one would you recommend and why? Justify your choice by analyzing the trade-offs of each approach regarding performance, operational cost, and system complexity.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
LLM Deployment Strategy Evaluation
LLM Deployment Strategy for a Multifunctional Application
A financial services company is building an internal AI platform. The platform needs to perform two very different, high-volume functions: 1) quickly answer employee questions about HR policies by searching a knowledge base, and 2) perform complex, nuanced sentiment analysis on financial news articles. The company's primary goal is to ensure maximum accuracy and performance for each function. Which of the following deployment strategies best aligns with this primary goal?