Constructing a Prompt-Tuned Input Sequence
An engineer is adapting a large language model for a sentiment analysis task. The input text is 'The movie was fantastic.' Describe the composition of the single input sequence that would be fed to the model if using a method where a set of trainable vectors are prepended to the standard text vectors. Your description must identify the two main components of the sequence, their order, and which part is adjusted during training.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An engineer is examining the input to a large language model that has been adapted for a new task. The input is visualized as a single sequence of vectors: [P1, P2, P3, P4, E1, E2, E3, E4, E5], where the 'P' vectors are adjusted during training and the 'E' vectors remain unchanged. Based on this structure, what is the most accurate analysis of this input method?
An engineer is designing the input for a large language model using a method where a small set of new, trainable vectors are prepended to the standard, frozen vectors of the input text. Below are four potential visual representations of this combined input sequence. Which diagram incorrectly illustrates this input composition?
Constructing a Prompt-Tuned Input Sequence