Learn Before
Using Retrieved Context to Improve Attention
External memory systems enhance the attention mechanism by first retrieving relevant stored context representations that match a given query. These retrieved representations are then incorporated to augment the attention calculation for that specific query, providing it with more relevant information.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Using Retrieved Context to Improve Attention
Retrieval-Based Methods as a Solution for Long-Context Processing
Unsuitability of External Memory for Streaming Contexts
k-NN as a Popular Retrieval-Based External Memory Method
Computational Cost of External Memory Models
Architectural Design for a Real-Time Chat Application
A company is building a question-answering system to help employees query a massive, static knowledge base of over 100,000 internal documents. The core language model has a fixed input size that is much smaller than the total size of the knowledge base. Which approach is the most effective and scalable for ensuring the model can access the necessary information to answer specific user queries accurately?
Evaluating the Use of External Memory Systems for LLMs
Augmented Input Formula for External Memories
Comparison of External Memories in LLMs
Learn After
A language model is designed to answer complex questions about a large, internal database of scientific papers. When it receives a user's question, it first performs a search to find the most relevant paragraphs from the papers. These selected paragraphs are then used to help the model formulate its final answer. Which statement best analyzes the primary role of these retrieved paragraphs in the model's internal processing?
Combined KV Cache for k-NN and Local Memory
A language model is equipped with an external memory system to enhance its responses. Arrange the following steps in the correct chronological order to show how the model uses this system to process a user's query.
Improving a Customer Support Chatbot