Learn Before
Deconstructing a Concatenated Token Sequence
A language model is given a combined token sequence represented by the notation [x, y]. The full sequence is: (Translate, to, French, :, The, cat, is, black, Le, chat, est, noir). If the output sequence y is (Le, chat, est, noir), what is the corresponding input sequence x?
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Probability of a Concatenated Token Sequence
An input sequence of tokens is defined as
x = (The, cat, sat)and a subsequent output sequence is defined asy = (on, the, mat). Which of the following correctly represents the single, combined sequence denoted by[x, y]?Using [SEP] Tokens for Sequence Concatenation
Deconstructing a Concatenated Token Sequence
Given two token sequences,
x = (start, process)andy = (end, result), the concatenated sequence denoted by[x, y]is identical to the sequence denoted by[y, x].