Formula

Content-Based Addressing (NTM Architecture)

In the Neural Turing Machine (NTM) architecture, content-based addressing focuses on memory locations based on the similarity between values emitted by the controller and the contents of memory. For both read and write operations, the controller first emits a key vector of length MM, denoted as ktk_t. This key vector is compared to each memory vector, Mt(i)M_t(i).

This method produces normalized weights, wtc(i)w_t^c(i), using a positive key strength, βt\beta_t: wtc(i)=exp(βtK[kt,Mt(i)])jexp(βtK[kt,Mt(j)])w_t^c(i) = \frac {\exp(\beta_t K[k_t, M_t(i)])} {\sum_j \exp(\beta_t K[k_t, M_t(j)])}

The similarity is measured using cosine similarity: K[u,v]=uvuvK[u, v] = \frac {u \cdot v} {\|u\| \|v\|}

0

1

Updated 2026-05-10

Tags

Data Science