Learn Before
Instruction-Following Ability of LLMs
A key characteristic of Large Language Models is their capacity to adhere to the prompts given by users to execute a wide range of tasks. This capability is commonly referred to as the instruction-following ability of the model.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Zero/Few-Shot Learning
A team is tasked with adapting a large, pre-trained language model to summarize legal documents. One developer designs a method where each summarization request includes a detailed set of instructions and examples of high-quality summaries, which are provided to the original, unchanged model. Another developer uses a large dataset of legal documents and their corresponding summaries to make small, permanent adjustments to the model's internal configuration before deploying it. What is the most significant difference between these two approaches regarding the pre-trained model itself?
Choosing a Model Adaptation Strategy
Key Areas of Prompt Engineering
Instruction-Following Ability of LLMs
Components of a Prompt: Instruction and User Input
When a language model successfully performs a new task based on a well-crafted prompt, its internal parameters are temporarily adjusted for the duration of that specific task to better align with the provided instructions.
Prompting as a Text Generation Task
Learn After
Evaluating an LLM's Instruction-Following Performance
A language model was given the following text and a specific set of instructions. Analyze the four responses below and identify which one demonstrates the best ability to follow all the given instructions.
Text: 'Solar energy is a renewable power source derived from the sun's radiation. It offers a significant advantage by reducing greenhouse gas emissions, which is crucial for combating climate change. Furthermore, solar panels can be installed on rooftops, making use of otherwise unused space and potentially lowering electricity bills for homeowners. The technology is continually improving, becoming more efficient and affordable.'
Instructions: 'Summarize the provided text in exactly three bullet points. Each bullet point must be a complete sentence and start with the phrase "The key takeaway is". Do not use the word "significant".'
Analyzing and Correcting Instruction-Following Failures