Example of a Constraint-First Prompt for Grammaticality Judgment
When evaluating grammaticality, a prompt can be organized by stating strict constraints on the answer format and meanings before presenting the target sentence. For instance, the prompt might begin with the rules: 'Yes or No? Yes = the following sentence is grammatically correct. No = it contains grammatical errors.' Right after these explicit instructions, the sentence to be judged is provided: 'LLMs are powerful models but are expensive to build.', followed by the desired response 'Yes'.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Related
Examples of Prompt Templates for Grammaticality Judgment
Placeholder in Prompt Templates
Example of a Prompt for Grammaticality Judgment
A developer is using a large, pre-trained language model, which excels at generating text continuations, to determine if a given sentence is grammatically correct. Which of the following approaches best describes how this task, traditionally a binary classification problem (correct/incorrect), is adapted for this type of model?
Adapting Grammaticality Judgment for Generative Models
Implementing a Grammar Checker with a Generative LLM
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment
Examples of Prompt Templates for Grammaticality Judgment
Example of Instantiating a Placeholder in a Grammaticality Judgment Prompt
Example of a Prompt for Grammaticality Judgment
A developer is building a system that uses a language model to summarize news articles. They need to create a single, reusable instruction that can work for any article provided by a user. Which of the following options correctly uses a placeholder to create such a flexible template?
Creating a Reusable Prompt Template
Match each term related to creating dynamic instructions for a language model with its correct description.
Examples of Prompt Templates for English-to-Chinese Translation
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment
Example of Defining Answer Semantics for Grammaticality Judgment
Example of Defining Category Semantics in a Polarity Classification Prompt
A data scientist is using a language model to classify customer feedback into 'Bug Report' or 'Feature Request'. Their initial prompt is:
Feedback: 'The app crashes when I try to upload a photo.' What kind of feedback is this?They observe that the model's outputs are inconsistent, including responses like 'This is a bug report,' 'It seems like a bug,' and 'The user is reporting a problem with the app.' Which of the following revised prompts best addresses this inconsistency by explicitly defining the required output format and the meaning of the categories?Improving Prompt Specificity for Automated Data Extraction
Refining a Prompt for Feature Request Identification
Example of a Constraint-First Prompt for Grammaticality Judgment
A team is fine-tuning a language model for a single, specific task: extracting the main sentiment (positive, negative, or neutral) from customer reviews. To ensure the final model is robust and can handle the varied ways users might phrase this request, which of the following training data strategies is the most effective?
Diagnosing a Fine-Tuning Data Issue
Generating Diverse Instructions for a Summarization Task
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment
Learn After
Refining a Prompt for Grammaticality Judgment
You are designing a prompt to ask a language model to judge the grammatical correctness of a sentence. Arrange the following components into the correct 'question-first' structure.
A specific method for asking a language model to evaluate a sentence's grammar involves a three-part structure: 1) The direct question is asked. 2) Instructions for the desired output format are given. 3) The sentence to be judged is provided. Which of the following prompts correctly applies this specific three-part structure?