Concept
Adaptor Layers as Soft Prompts
In the context of parameter-efficient fine-tuning, adaptor layers inserted between existing model layers can be viewed as a type of soft prompt. These layers encode prompting and task-specific information, interacting with the original, frozen Large Language Model to facilitate its adaptation to new tasks.
0
1
Updated 2026-04-30
Tags
Foundations of Large Language Models
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences