Learn Before
Example of a T5 Question-Answering Sample
The T5 text-to-text framework can be applied to question-answering tasks by formatting both the input and the target output as text strings. For instance, a question is presented with a prefix like 'Answer:', and the model is trained to generate the corresponding answer. A complete example of this format is: [CLS] Answer: when was Albert Einstein born? → ⟨s⟩ He was born on March 14, 1879.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Example of a T5 Machine Translation Training Sample with Special Tokens
Example of a T5 Question-Answering Sample
Example of a T5 Simplification Task Sample
Differentiating Encoder and Decoder Sequences with Start Symbols
Versatility of the T5 Text-to-Text Format
Definition of c_gold
Formula for Input Embedding Composition
A researcher wants to train a model to perform a new task: converting a sentence from passive voice to active voice. Given the passive input sentence 'The cake was eaten by the dog' and the desired active output 'The dog ate the cake', which of the following training samples is correctly structured according to the unified, prefix-based text-to-text format?
Critiquing a Text-to-Text Training Sample
A single text-to-text model is being trained on a dataset containing samples for four different tasks. Each sample's input begins with a prefix that instructs the model on what to do. Match each input sample (Source Text) with the most likely task it is intended for.
Learn After
A researcher is preparing data for a unified text-to-text model. To have the model perform a question-answering task, the input data must be structured as a single text string that begins with a specific instruction, followed by the question itself. Based on this requirement, which of the following examples is formatted correctly to serve as the model's input?
Formatting a Training Sample for a Text-to-Text Model
Analyzing an Incorrect T5 Question-Answering Sample