An AI development team is training a large language model to be a helpful assistant. They initially use a training method based on a large, fixed dataset of human-written conversations. They observe that the model performs poorly on user requests that are structured differently from the training examples. To improve performance, they switch to a method where the model continuously interacts with a system that provides feedback on its responses, allowing it to learn from new interactions. Which k
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Chatbot Performance Degradation
An AI development team is training a large language model to be a helpful assistant. They initially use a training method based on a large, fixed dataset of human-written conversations. They observe that the model performs poorly on user requests that are structured differently from the training examples. To improve performance, they switch to a method where the model continuously interacts with a system that provides feedback on its responses, allowing it to learn from new interactions. Which k
An AI development team is using an interactive, real-time feedback system to continuously train a language model. Match each observed improvement in the model's behavior to the underlying advantage of this training method.