Learn Before
Notation for Source and Target Sequences
In sequence modeling architectures, standard notation is used to represent the inputs and outputs. A source sequence is typically denoted as , where represents the length of the source sequence. Its corresponding sequence of embedding vectors is denoted as . Similarly, the target sequence that the model aims to generate is denoted as , with length , and its corresponding embedding sequence is represented as .
0
1
Tags
Foundations of Large Language Models
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Predictions with Sequences
Sequence Prediction Models
Sequence Classification Models
Recurrent Neural Network (RNN)
Sequence Model Question #1
Sequence Model Question #2
Sequence Moel Question #4
Sequence Model Question #3
Tokenization
Notation for Source and Target Sequences
Interpolation vs. Extrapolation in Sequence Models
Forward vs. Reverse Direction Estimation
Reading Raw Text for Sequence Data