Short Answer

Analyzing a Fine-Tuning Dataset's Limitations

A team fine-tunes a pre-trained language model using a large dataset where every entry is a simple question-and-answer pair, such as {'instruction': 'What is the capital of France?', 'response': 'Paris'}. After training, the model excels at answering factual questions but fails to follow more complex commands like 'Write a poem about the ocean' or 'Summarize this paragraph.' Analyze the provided data sample and explain why a dataset composed exclusively of such examples leads to this limited performance.

0

1

Updated 2025-10-10

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science