Examples of Prompt Templates for Grammaticality Judgment
Grammaticality judgment can be reframed as a text generation task by using a prompt template, which often uses a placeholder like {*sentence*} for the text to be evaluated. The prompt's structure can vary significantly. For instance, given a sentence, several formats are possible:
-
Question First: The query precedes the sentence.
Question: Is this sentence grammatically correct? John seems happy today. -
Sentence First with Answer Cue: The sentence is followed by the question and a cue for the model's response.
John seems happy today. Question: Is this sentence grammatically correct? Answer: -
Command-based Instruction: The prompt is phrased as a command followed by the sentence.
Read the following sentence, and answer whether it is grammatically correct. LLMs are powerful models but are expensive to build. -
Sentence First with Natural Question: The sentence is presented, followed by a more conversational question, often on a new line.
LLMs are powerful models but are expensive to build. Does this sentence make sense grammatically?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Examples of Prompt Templates for Grammaticality Judgment
Example of Instantiating a Placeholder in a Grammaticality Judgment Prompt
Example of a Prompt for Grammaticality Judgment
A developer is building a system that uses a language model to summarize news articles. They need to create a single, reusable instruction that can work for any article provided by a user. Which of the following options correctly uses a placeholder to create such a flexible template?
Creating a Reusable Prompt Template
Match each term related to creating dynamic instructions for a language model with its correct description.
Examples of Prompt Templates for English-to-Chinese Translation
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment
Examples of Prompt Templates for Grammaticality Judgment
Placeholder in Prompt Templates
Example of a Prompt for Grammaticality Judgment
A developer is using a large, pre-trained language model, which excels at generating text continuations, to determine if a given sentence is grammatically correct. Which of the following approaches best describes how this task, traditionally a binary classification problem (correct/incorrect), is adapted for this type of model?
Adapting Grammaticality Judgment for Generative Models
Implementing a Grammar Checker with a Generative LLM
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment
Learn After
Newline Character (\n)
Defining Answer Format and Semantics in Prompts
A researcher wants to test a language model's ability to judge the grammar of various sentences. They decide that for their experiment, the prompt must present the sentence to be evaluated before asking the model to make a judgment. Which of the following prompt designs meets this specific structural requirement?
Analyze the structure of each prompt template below and match it with the correct description of its format.
Improving Prompt Design for Grammaticality Judgment