A diagram of a language model's inference process shows two parallel streams originating from a single query vector. The first stream processes the query against a local cache of recent context to produce a probability distribution. The second stream uses the same query to search a large external datastore, retrieving similar past examples to form a second probability distribution. Finally, these two distributions are combined for the final prediction. What is the primary advantage of this dual-stream architecture as depicted?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Analyzing Factual Recall in a Dual-Stream Language Model
A diagram of a language model's inference process shows two parallel streams originating from a single query vector. The first stream processes the query against a local cache of recent context to produce a probability distribution. The second stream uses the same query to search a large external datastore, retrieving similar past examples to form a second probability distribution. Finally, these two distributions are combined for the final prediction. What is the primary advantage of this dual-stream architecture as depicted?
A diagram of a k-NN Language Model's inference process shows several key components. Match each component with its correct function in the process.