Two Levels of Generalization in Instruction-Tuned LLMs
The generalization capability of an instruction-fine-tuned LLM can be assessed at two distinct levels. The first is intra-task generalization, which is the model's ability to generate correct outputs for new inputs within a single task. The second, more complex level is inter-task generalization, which refers to the model's capacity to perform accurately across a variety of different tasks as defined by diverse instructions.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Two Levels of Generalization in Instruction-Tuned LLMs
Complexity of Generalization due to Instruction and Input Variation
A development team fine-tunes a large language model to be a helpful assistant for summarizing legal documents. They use a large dataset of legal texts and their corresponding summaries. After deployment, they observe the following:
- The model performs exceptionally well when asked to summarize new, unseen legal documents (e.g., contracts, court rulings).
- However, when users give it slightly different instructions, such as 'Explain this legal clause in simple terms,' 'Extract the key dates
Evaluating Fine-Tuning Strategies for Generalization
Performance Metric for Instruction-Tuned LLMs
Formal Representation of an Instruction-Tuned LLM
A large language model has been fine-tuned on a variety of instructional tasks. Match each of the following performance observations with the specific type of generalization challenge it represents.
Learn After
LLM Generalization Evaluation
Formal Definition of Intra-Task Generalization
An AI team fine-tunes a language model exclusively on a dataset for a single task: translating English legal documents into French. The model is then evaluated on two test sets.
- Test Set A: A new, unseen collection of English legal documents to be translated into French.
- Test Set B: A collection of diverse tasks, such as writing Python code, composing poetry, and summarizing news articles.
The model performs very well on Test Set A but performs poorly on Test Set B. What does this
Analyzing LLM Performance
Formula for Generalization Across Tasks
Informal Definition of Intra-Task Generalization