Learn Before
System Information in Prompts
System information, sometimes referred to as a system prompt, is a component of the input provided to a Large Language Model. Its purpose is to establish the context or define the constraints for the task the model is expected to perform.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Prompting as a Form of Inference-Time Alignment
Rescoring and Reranking for Inference-Time Alignment
A company deploys a large, pre-trained language model for its public-facing chatbot. Due to immense computational costs, they cannot alter the model's core programming or retrain it. To ensure the chatbot's responses are consistently helpful and harmless, they implement a new system. This system works by having the original model generate five different potential answers for every user query. A second, much smaller, specialized model then rapidly evaluates these five answers based on safety and helpfulness criteria, and only the highest-scoring answer is displayed to the user. Which principle does this company's strategy best illustrate?
Choosing an LLM Alignment Strategy
System Information in Prompts
LLM Deployment Strategy for a Startup
Learn After
An e-commerce company wants to deploy a chatbot to handle customer support inquiries. The primary goals are to ensure the chatbot is always polite, helpful, and strictly avoids offering unauthorized discounts. Which of the following system information snippets would be most effective in constraining the model's behavior to meet all these requirements?
Debugging LLM Behavior via System Information Analysis
Crafting a System Prompt for a Summarization Task