Input Sequence Formatting Analysis
A junior data scientist has prepared the following input sequence for a model that needs to understand the relationship between two sentences: The sun is bright. [SEP] The sky is blue. [CLS]. Identify two distinct formatting errors in this sequence and explain the correct placement and purpose of the special tokens involved.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is being prepared for a task that involves understanding the relationship between two sentences. Given Sentence A: 'The model learns patterns.' and Sentence B: 'It then makes predictions.', which of the following represents the correctly formatted single input sequence for the model, using special tokens to delineate the structure?
Input Sequence Formatting Analysis
Constructing a Sentence-Pair Input Sequence
Illustration of Transformer Encoding for Sequence Classification