Activity (Process)
Getting Attention Weight in DKVMN
In the Dynamic Key-Value Memory Network (DKVMN), the first step of its working mechanism is getting the attention weight. The knowledge component is extracted from the embedding matrix and used as a query to search the key memory matrix . This produces an attention weight vector that measures how much attention should be paid to each value in the value memory matrix:
where , is the -th row vector of the key memory, and is the -th element of the attention weight vector.
0
1
Updated 2026-06-16
Tags
Data Science