Case Study

Language Model Performance Analysis

A language model was fine-tuned with a dataset consisting exclusively of instructions in two formats: 'Translate the following English text to French: [text]' and 'Summarize this article: [article]'. After training, the model performs perfectly on instructions matching these formats. However, when given the new prompt, 'Can you briefly explain the main points of this article and then provide a French translation of your explanation?', the model only provides a summary and does not attempt the translation. Based on this outcome, analyze the most likely reason for the model's partial failure. What fundamental challenge in training helpful models does this scenario illustrate?

0

1

Updated 2025-09-26

Contributors are:

Who are from:

Tags

Ch.4 Alignment - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science