Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
A grammaticality judgment prompt can be designed by first providing the sentence to be assessed, followed by a related question, and ending with clear multiple-choice options for the answer. For example, the sentence 'LLMs are powerful models but are expensive to build.' is presented at the beginning. This is followed by asking 'Does this sentence make sense grammatically?' and supplying an 'Answer Option' list that explicitly states the choices '- Yes' and '- No', along with the expected final response 'Yes'.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Examples of Prompt Templates for Grammaticality Judgment
Placeholder in Prompt Templates
Example of a Prompt for Grammaticality Judgment
A developer is using a large, pre-trained language model, which excels at generating text continuations, to determine if a given sentence is grammatically correct. Which of the following approaches best describes how this task, traditionally a binary classification problem (correct/incorrect), is adapted for this type of model?
Adapting Grammaticality Judgment for Generative Models
Implementing a Grammar Checker with a Generative LLM
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment
Examples of Prompt Templates for Grammaticality Judgment
Example of Instantiating a Placeholder in a Grammaticality Judgment Prompt
Example of a Prompt for Grammaticality Judgment
A developer is building a system that uses a language model to summarize news articles. They need to create a single, reusable instruction that can work for any article provided by a user. Which of the following options correctly uses a placeholder to create such a flexible template?
Creating a Reusable Prompt Template
Match each term related to creating dynamic instructions for a language model with its correct description.
Examples of Prompt Templates for English-to-Chinese Translation
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment
MMLU Benchmark
A team of engineers is evaluating a new language model's reasoning capabilities. They use an assessment method where the model must choose the single correct answer from a set of provided options for each question. Which of the following represents a primary limitation of this evaluation method for gauging the model's genuine comprehension?
AI Tutor Design Strategy
Designing a Challenging Multiple-Choice Question for a Language Model
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
A team is fine-tuning a language model for a single, specific task: extracting the main sentiment (positive, negative, or neutral) from customer reviews. To ensure the final model is robust and can handle the varied ways users might phrase this request, which of the following training data strategies is the most effective?
Diagnosing a Fine-Tuning Data Issue
Generating Diverse Instructions for a Summarization Task
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment
Learn After
Improving Prompt Reliability for Automated Text Checking
A developer needs to create a prompt for a language model to determine if a given sentence is grammatically sound. The prompt design requires presenting the sentence first, followed by a direct question, and finally, clear instructions that restrict the model's output to one of two predefined words, with each word's meaning explicitly defined. Which of the following prompts best adheres to this design for the sentence 'The cat sat on the mat quickly.'?
A developer is creating a 'sentence-first' prompt to have a language model judge the grammatical correctness of a sentence. Arrange the following components into the correct structural order for this type of prompt.