LLM Alignment Strategy for a Resource-Constrained Organization
Based on the organization's constraints described in the case study, which general approach to aligning the model's behavior would be more suitable: an approach that requires creating a new version of the model through additional, computationally-heavy training, or one that guides the existing model's output generation process in real-time without any retraining? Justify your choice by explaining the primary advantage of your selected approach in this specific context.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
LLM Alignment Strategy for a Resource-Constrained Organization
A technology startup has access to a powerful, pre-trained language model. However, they operate with a limited budget, which restricts their access to the large-scale computing clusters required for extensive model retraining. Their goal is to quickly deploy a chatbot that avoids generating harmful or biased content. Which of the following approaches is the most logical for them to adopt, and why?
Comparing LLM Alignment Strategies: Fine-Tuning vs. Inference-Time