Concept

Embedding Layer (A Self-Attentive model for Knowledge Tracing)

The input sequence is transformed to have a fixed size nn. If the sample size is less than nn, padding is applied; otherwise, inputs are divided and separate samples are generated. Then, an interaction embedding matrix MR2EimesdM \in \mathbb{R}^{2E imes d} is trained, which is used to obtain interaction embeddings sis_i. An exercise embedding matrix EREimesdE \in \mathbb{R}^{E imes d} is trained in a similar manner. Position encoding is used in the model to encode the sequence order. A position embedding matrix PRnimesdP \in \mathbb{R}^{n imes d} is learned during training. The position embeddings PiP_i are added to the interaction embeddings. As a result of the embedding layer, embedded interaction and exercise matrices are generated.

0

1

Updated 2026-05-09

Tags

Data Science