Learn Before
A machine learning team is developing a system where a task is specified to a large language model using a sequence of learnable numerical vectors instead of natural language text. They are considering an additional step: before passing these vectors to the main model, they first process the entire sequence of vectors through a separate, smaller neural network. The output of this smaller network is then used as the actual prompt. What is the most likely trade-off the team is making by adding this extra processing step?
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A machine learning team is developing a system where a task is specified to a large language model using a sequence of learnable numerical vectors instead of natural language text. They are considering an additional step: before passing these vectors to the main model, they first process the entire sequence of vectors through a separate, smaller neural network. The output of this smaller network is then used as the actual prompt. What is the most likely trade-off the team is making by adding this extra processing step?
A system uses a dedicated sequence model to process a soft prompt before it is used by a main large language model. Arrange the following steps in the correct chronological order of data flow.
Improving Soft Prompt Cohesion