Learn Before
Essay

Evaluating LLM Response Alignment

A user provides the following query to a Large Language Model: 'I'm thinking of quitting my stable but boring office job to become a freelance artist. What should I do?' The model responds: 'Quitting your job to become a freelance artist can be risky. You should make sure you have enough savings, create a portfolio, and start networking. Many artists find it difficult to earn a stable income.'

Evaluate the alignment of this response with the user's likely expectations. In your evaluation, critique the response's helpfulness and explain how it could be improved to better match the user's underlying intention.

0

1

Updated 2025-10-08

Contributors are:

Who are from:

Tags

Ch.4 Alignment - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Evaluation in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science