Short Answer

Diagnosing Issues in Instruction Inference

A developer wants an LLM to generate the instruction: 'Classify the sentiment of the text as Positive, Negative, or Neutral.' They provide the LLM with the following input-output examples to infer this instruction:

  • Input: 'I love this new phone!' -> Output: 'Good'
  • Input: 'The service was terrible.' -> Output: 'Bad'
  • Input: 'The movie was okay, I guess.' -> Output: 'Fine'

However, the LLM generates a vague instruction like 'Analyze the text provided.' Analyze the developer's examples and explain the most likely reason for this outcome. Then, suggest a specific improvement to the output examples to help the LLM generate the desired instruction.

0

1

Updated 2025-10-02

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science