Learn Before
Input and Output Formulation in BoN Sampling
In the Best-of- (BoN) sampling process, the large language model receives an input sequence, denoted as , and produces a set of distinct output sequences, represented as .
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.4 Alignment - Foundations of Large Language Models
Related
Input and Output Formulation in BoN Sampling
Generating N-Best Candidates in BoN Sampling
Reward Model Selection in BoN Sampling
Rejection Sampling for LLM Fine-Tuning
A company wants to improve the safety and helpfulness of its AI assistant without the high cost and time of retraining the entire base model. They propose a new system for handling user queries: for each query, the system will first generate 10 different potential responses. Then, a separate, fast-acting 'quality-scoring' model will evaluate all 10 responses based on pre-defined criteria. Finally, the system will present only the single response that received the highest score to the user. What is the most significant trade-off of this approach compared to simply using the first response the base model generates?
A system is designed to improve the quality of its generated text by producing multiple options and then picking the best one. Arrange the following steps of this process in the correct logical order.
Chatbot Response Quality Improvement
Learn After
Mathematical Formulation of BoN Sampling
A language model is tasked with generating three different possible email subject lines for a marketing campaign. The model is provided with the full text of the email body as a single prompt. Based on this generation process, which statement correctly describes the structure of the inputs and outputs?
To generate a set of N distinct output sequences using the Best-of-N (BoN) sampling process, a language model must be provided with N separate and distinct input sequences.
Applying Sampling for Code Generation