Concept

Adaptor Layers as Soft Prompts

In the context of parameter-efficient fine-tuning, adaptor layers inserted between existing model layers can be viewed as a type of soft prompt. These layers encode prompting and task-specific information, interacting with the original, frozen Large Language Model to facilitate its adaptation to new tasks.

0

1

Updated 2026-04-30

Contributors are:

Who are from:

Tags

Foundations of Large Language Models

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences