Learn Before
Analyzing an Incorrect T5 Question-Answering Sample
A machine learning engineer is preparing a dataset for a text-to-text model to perform a question-answering task. They have created the following training sample: [CLS] what is the capital of France? → ⟨s⟩ The capital is Paris. Identify the primary error in this sample's format and explain why it would likely cause the model to perform poorly.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A researcher is preparing data for a unified text-to-text model. To have the model perform a question-answering task, the input data must be structured as a single text string that begins with a specific instruction, followed by the question itself. Based on this requirement, which of the following examples is formatted correctly to serve as the model's input?
Formatting a Training Sample for a Text-to-Text Model
Analyzing an Incorrect T5 Question-Answering Sample