A development team starts with a large language model that has been pre-trained on a vast corpus of text from the internet, giving it a broad base of general knowledge. To make it a better customer service assistant, they then fine-tune it on a specific dataset of support chat logs. After this fine-tuning, they observe that while the model excels at customer service conversations, its performance on general trivia questions has noticeably degraded. What does this outcome most directly illustrate?

Chatbot Development Strategy

Balancing General and Specific Knowledge in Model Training