Constructing a Training Sample for a Summarization Task
You are preparing data to fine-tune a text-to-text model for a summarization task. Given the source article text "The sun is a star at the center of the Solar System." and the target summary "The sun is a star.", construct a complete, single-line training sample. Your sample must include a task-specific instruction and the appropriate, distinct start symbols for the source and target sequences.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A model is being trained on the following data sample for a translation task:
[CLS] Translate from Spanish to French: ¿Cómo estás? → <s> Comment vas-tu?Based on the structure and special tokens in this sample, what specific sequences are provided as input to the model's two main components?A data scientist is preparing a training sample for a text-to-text model designed for English to German translation. They create the following sample:
Translate from English to German: How are you? → <s> Wie geht es Ihnen? [CLS]Which of the following best describes the primary error in this sample's structure?Constructing a Training Sample for a Summarization Task