Learn Before
Essay

Analyzing Model Performance on Novel Instructions

Imagine a language model has been trained on two distinct sets of instructions. The first set teaches it to identify and describe various shapes (e.g., 'describe a square', 'identify the triangle'). The second set teaches it to identify and describe various colors (e.g., 'what color is this?', 'show me something blue'). The model has never been trained on an instruction that combines a specific shape with a specific color. Analyze the model's likely performance if it is given the novel prompt, 'describe the blue square'. In your analysis, explain what successful performance on this task would demonstrate about the model's learning capabilities, and conversely, what failure would signify.

0

1

Updated 2025-10-10

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science