Learn Before
Evaluating Predicted Sequences
The process of assessing the quality of a sequence of predicted future values, such as , is accomplished by applying an evaluation model. This model utilizes a probability function, represented generally as or more specifically as , to determine the likelihood of the predicted sequence.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Evaluating Predicted Sequences
Assessing Predictive Text Systems
A researcher is developing a system that predicts the next five words in a sentence. After the system generates a sequence of five words, denoted as , the researcher wants to use a probabilistic evaluation model, , to assess the quality of the entire generated sequence as a whole. Which of the following expressions correctly represents this evaluation?
When using a probabilistic framework to assess the quality of a predicted sequence of five future values, , the most comprehensive approach is to calculate the probability of each value separately and then average the results.
Diagram of an Evaluation Model Assessing a Predicted Sequence
Learn After
A system generates several possible sequences of values to predict a future outcome. An evaluation model then calculates the probability of each entire sequence occurring. Based on this method, which of the following predicted sequences would be considered the highest quality prediction?
Selecting the Best Predicted Sequence
When assessing the quality of a predicted sequence of future values, the most effective method is to calculate the probability of each individual value in the sequence and then average these probabilities to find the overall quality score.