Sensitivity Analysis and Vector Space Dimensionality (Knowledge Query Network for Knowledge Tracing)
In order to measure the impact of the embedding dimension on the models performance different values were tried, d = , , 2. For each pair from these three pairwise skill distance was calculated as:
refers to the pairwise distance and N is number of skills. Then the is compared to average pairwie distance :
According to this experiment, KQN learned the skill relationship in a better manner when d was higher. Additionally, the authors used Mantel tests to measure the similarity between 2 distance matrices. It showed that when predicting the probability of the correctness as well as for learning relation between skill vectors KQN model is stable for different d values.
0
1
Tags
Data Science