Short Answer

Designing a Fine-Tuning Strategy for Long-Context Tasks

A customer service company uses a large language model to analyze support chat transcripts. The model was originally trained on text segments with a maximum length of 4,096 tokens and performs well on short conversations. However, its performance degrades significantly when analyzing complex, multi-turn support cases that often exceed 8,000 tokens. You are tasked with improving the model's performance on these longer transcripts. Describe the most critical characteristic of the data you would select for a targeted fine-tuning process to address this specific problem.

0

1

Updated 2025-10-06

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Application in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science