Calculating Conditional Log-Probability from Model Outputs
Based on the provided case study, what is the conditional log-probability of the completion ['sunny'] given the prompt ['The', 'weather', 'is']? Explain how you arrived at your answer.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Initial Representation for Concatenated [x, y] Sequences
A data scientist is using a large language model to determine the conditional log-probability of a specific completion
yfollowing a given promptx. Their process involves concatenating the two sequences into[x, y]and then performing a single forward pass to compute the log-probability of this combined sequence, which they take as their final result. Which statement best analyzes the flaw in this methodology?You are tasked with using a large language model to compute the conditional log-probability of an output sequence
ygiven an input sequencex. Arrange the following computational steps into the correct chronological order.Calculating Conditional Log-Probability from Model Outputs