Learn Before
Essay

Evaluating Context Expansion for a Chatbot

A company is developing a customer support chatbot designed to handle long, multi-turn conversations. They are debating between two strategies for handling the conversation history during inference: 1) Truncating the history to only include the last few user-chatbot exchanges to minimize computational cost, or 2) Providing the full, unabridged conversation history to the model for every new response. Evaluate the potential trade-offs of the second strategy (providing the full history) in terms of response quality, computational requirements, and overall user experience. Justify your evaluation with specific examples of how this strategy might succeed or fail.

0

1

Updated 2025-10-07

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Evaluation in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science