Inference Process with a Fine-Tuned Model

Probability Distribution Formula for an Encoder-Softmax Language Model

A language model has been trained on a large corpus of English text. When given the sentence 'The chef carefully seasoned the soup with a pinch of ____.', which of the following best represents the direct output the model calculates for the blank position?

Evaluating Sentence Probability

Impact of Training Data on Probability

Probability Distribution Formula for an Encoder-Softmax Language Model

Output Probability Calculation in Transformer Language Models

Next-Token Probability Calculation in Autoregressive Decoders

A neural network produces a final matrix of hidden state vectors, H, with dimensions [sequence_length × hidden_dimension]. To generate a probability distribution over a vocabulary of size V for each position in the sequence, a parameterized Softmax layer is used, which computes Softmax(H ⋅ W). What is the primary role and required shape of the weight matrix W in this operation?

Debugging a Parameterized Softmax Layer

A parameterized Softmax layer is used to convert a sequence of hidden state vectors into a sequence of probability distributions over a vocabulary. Arrange the following steps of this process into the correct chronological order.

Probability Distribution Formula for an Encoder-Softmax Language Model

Auto-Regressive Generation Process

Formal Definition of LLM Inference

Model Parameterization by θ

A language model built with a deep neural network is given the input sequence 'The cat sat on the'. The model's vocabulary consists of the following tokens: {a, cat, hat, mat, on, sat, the}. What does the model produce as its immediate, direct output to predict the very next token?

Analyzing Language Model Outputs

Explaining Language Model Output Behavior

Equation for Generating Sequence Representations

Probability Distribution Formula for an Encoder-Softmax Language Model

A pre-trained sequence encoding model processes the input sentence 'The quick fox'. After tokenization, the input is a sequence of 3 tokens: {'The', 'quick', 'fox'}. The model then generates a numerical representation, H, which is a matrix of real-valued vectors. Based on the typical function of such a model, which statement best describes the output matrix H?

Contextual Representation Analysis

Consider a pre-trained sequence encoding model that generates a numerical representation H = {h_0, h_1, ..., h_m} for an input sequence of tokens x = {x_0, x_1, ..., x_m}. The vector h_i representing the token x_i will be the same regardless of the other tokens that appear alongside it in the input sequence.

Probability Distribution Formula for an Encoder-Softmax Language Model