Improving Prompt Design for Grammaticality Judgment
Analyze the following scenario and the provided prompt. Explain why this prompt structure is likely leading to ambiguous responses from the language model. Then, propose a revised, more effective prompt that is designed to elicit a clear, binary judgment (e.g., 'Correct' or 'Incorrect').
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Newline Character (\n)
Defining Answer Format and Semantics in Prompts
A researcher wants to test a language model's ability to judge the grammar of various sentences. They decide that for their experiment, the prompt must present the sentence to be evaluated before asking the model to make a judgment. Which of the following prompt designs meets this specific structural requirement?
Analyze the structure of each prompt template below and match it with the correct description of its format.
Improving Prompt Design for Grammaticality Judgment