A development team trains a large language model on a vast dataset of high-quality, curated instruction-and-response pairs to create a helpful chatbot. After this training, they observe that while the model answers most questions correctly, it occasionally generates responses that are subtly biased or confidently presents outdated, incorrect information when faced with novel or ambiguous user queries. Which of the following statements best analyzes the fundamental limitation demonstrated by the model's behavior?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Learning from Human Feedback
A development team trains a large language model on a vast dataset of high-quality, curated instruction-and-response pairs to create a helpful chatbot. After this training, they observe that while the model answers most questions correctly, it occasionally generates responses that are subtly biased or confidently presents outdated, incorrect information when faced with novel or ambiguous user queries. Which of the following statements best analyzes the fundamental limitation demonstrated by the model's behavior?
Evaluating a Chatbot's Training Limitations
Analyzing Model Behavior After Instruction-Based Training