Learn Before
Evaluating Contextual Coherence in a Language Model's Response
A user provides the following prompt to a language model: 'I'm looking for a good book to read on my vacation. I really enjoy historical fiction, but nothing too heavy.' The model responds with: 'The Theory of Relativity by Albert Einstein is a seminal work in physics.' In 2-3 sentences, explain why the model's response fails to utilize the conversational context effectively. Then, provide one example of a more appropriate response.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Example Prompt for Conversation Completion
A language model is given the following two lines of a conversation and is tasked with generating the next line for Speaker A.
Speaker A: "I finally finished assembling that new bookshelf, but I have a dozen screws left over." Speaker B: "That happens to me all the time. I just toss them in a drawer and hope for the best."
Which of the following responses for Speaker A best demonstrates an effective use of the preceding conversational context to generate a coherent continuation?
Analyzing a Chatbot's Conversational Failure
Evaluating Contextual Coherence in a Language Model's Response