Imagine two teams are building a language model designed to process and answer questions about very long documents.

• Team A's approach: Modifies the attention mechanism so that each new word only pays attention to a small, fixed number of the most recent preceding words and a few important words from the distant past.
• Team B's approach: Uses a standard attention mechanism but, instead of letting it access all previous words, it feeds the mechanism a separate, continuously updated, fixed-size summary of the document's context so far.

Analyze the fundamental difference between these two strategies in how they address the challenge of a growing context. In your analysis, focus on where the complexity is managed: within the attention calculation itself or in a component separate from it.