Formula

Embedding Layer (A Self-Attentive model for Knowledge Tracing)

The input sequence is transformed to have a fixed size nn. If the sample size is less than nn, padding is applied; otherwise, inputs are divided and separate samples are generated. Then, an interaction embedding matrix MR2E×dM \in \mathbb{R}^{2E \times d} is trained, which is used to obtain interaction embeddings sis_i. An exercise embedding matrix ERE×dE \in \mathbb{R}^{E \times d} is trained in a similar manner. Position encoding is used in the model to encode the sequence order. A position embedding matrix PRn×dP \in \mathbb{R}^{n \times d} is learned during training. The position embeddings PiP_i are added to the interaction embeddings. As a result of the embedding layer, embedded interaction and exercise matrices are generated.

0

1

Updated 2026-07-05

Tags

Data Science