AI Alignment Strategy Selection
Given the following case study, which alignment approach should the startup choose to best meet their constraints? Justify your answer by comparing the implementation complexity and computational efficiency of the two approaches.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team of AI developers is refining a language model using a dataset of human preferences. Each data point consists of a prompt, a 'chosen' response, and a 'rejected' response. Instead of first training a separate model to score how good a response is and then using that score to guide the language model, they directly adjust the main language model's parameters to increase the probability of generating 'chosen' responses over 'rejected' ones. What is a key advantage of this direct adjustment method?
AI Alignment Strategy Selection
Mechanism of Direct Policy Optimization