Deconstructing the Prediction Combination Formula
A team is using a language model for a sentiment analysis task on a customer review. They use 4 different prompts, which results in 4 separate predictions for the sentiment. The team then uses the general formula ŷ = Combine(ŷ₁, ..., ŷₖ) to determine the final sentiment. Break down this formula by explaining what each of the following components represents in the context of this specific task: K, ŷᵢ (where i is from 1 to K), and ŷ.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Combination Strategies for Prompt Ensembling
A team is developing a system to generate a single, highly accurate description for an image. They provide a language model with the same image but use five different instructional phrases to guide the description generation process. This results in five distinct text descriptions of the image. The team's final step is to aggregate these five descriptions into one consolidated output. How does the general formula for combining multiple predictions,
ŷ = Combine(ŷ₁, ..., ŷₖ), map to this team's process?Analyzing a Failure in Prediction Combination
Deconstructing the Prediction Combination Formula