Concept

k-NN Language Modeling (k-NN LM)

k-NN Language Modeling (k-NN LM) is a specific application of k-NN-based retrieval that uses this technique for purposes other than directly improving the attention mechanism. Instead of augmenting attention, k-NN LM enhances next-token prediction by incorporating information from the nearest neighbors found in an external datastore, thereby expanding the model's effective context.

Image 0

0

1

Updated 2026-05-02

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Related
Learn After