Learn Before
Conditional Probability Pr^t(y|c, z)
The expression denotes the conditional probability of an output variable given two conditioning variables, and . The superscript can indicate a specific state or version of the model, such as at a particular training step. This formulation is central to probabilistic predictive models, where it is used to quantify the likelihood of a particular outcome based on given context and other factors.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Objective Function in Machine Learning
Least Squares Approach
Formal Definition of the Predicted Value (ŷ)
A real estate company uses a machine learning model to estimate the market value of houses. For a specific house with 3 bedrooms and 2,000 square feet of living space, the model calculates an estimated value of $450,000. The house later sells for an actual price of $465,000. In the context of this predictive model, what does the $450,000 figure represent?
Analyzing Model Predictions
Conditional Probability Pr^t(y|c, z)
Analyzing a Predictive Model's Performance
Linear Regression Analytic Solution
Learn After
A predictive text model is being trained. At an early stage of training (state t=100), it is given the context c = 'The sky is' and an additional instruction z = 'use a common color'. The model calculates the probability of the next word y = 'blue' as Pr^100('blue' | c, z) = 0.2. After extensive training (state t=5000), the model re-evaluates the same inputs and finds the probability to be Pr^5000('blue' | c, z) = 0.8. What is the most accurate interpretation of this change?
A language model is being prompted to generate a JSON object. The model is at training step 5000. The prompt is: 'Given the user's request to find a coffee shop, provide the output in a structured format.' The model is considering 'name' as the next part of the output. Match each component of the probability expression
Pr^t(y|c, z)to its corresponding element in this scenario.LLM Probability Distribution Notation ()
Analyzing Chatbot Behavior with Conditional Probability