Applying the Student Model Probability Notation
A team is training a compact language model for a smartphone application. This 'student' model, whose adjustable parameters are denoted by , is designed to be efficient. It receives a summarized user prompt () and an internal state vector () as input. Based on this information, write the mathematical expression that represents the student model's output probability distribution. Then, briefly explain the role of and in this expression.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Loss Function for Conditional Probability Distributions ()
A machine learning team is developing a compact, efficient language model, which we'll call model 's'. The model's behavior is governed by a set of tunable weights, denoted by θ. For a given task, the model receives a simplified context input, c', and a latent variable, z, and then generates a probability distribution over all possible outputs. Which of the following expressions correctly represents this model's output probability distribution?
In the expression , which describes a model's output probability distribution, match each symbol to its correct description.
Applying the Student Model Probability Notation