Learn Before
Unifying Principle in Model Guidance
A research team develops a method to summarize lengthy documents by creating a compact, continuous representation that allows a language model to answer questions about the original document without re-reading it. Another team uses a very similar method to create a compact, continuous representation that guides a model to adopt a specific persona (e.g., a pirate) based on a few examples of pirate speech. Analyze the underlying principle that connects these two seemingly different applications. In your analysis, explain how one of these concepts can be viewed as a specific instance of the other.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Applicability of Context Compression to General Text Compression
A developer is trying to make a language model consistently adhere to a long, complex style guide. Instead of providing the entire guide with every request, they use a technique to distill the guide's key principles into a compact, learned set of instructions that is automatically prefixed to each user's input. Which statement best analyzes the relationship between the full style guide and the compact, learned instructions in this scenario?
Unifying Principle in Model Guidance
The Relationship Between Prompts and Contexts