Concept

Improved Concept Embeddings for Learning Prerequisite Chains: mAP

For a single node/concept uu in the co-occurrence graph GG, the Average Precision (AP) is calculated in two steps.

  1. Constructed a list labels={l1,l2,...,ln}labels = \{l_1, l_2, ..., l_n\}, where li=1l_i = 1 if ii is a child of uu and 0 otherwise, and calculated a list distances={d1,d2,...,dn}distances = −\{d_1, d_2, ..., d_n\}, where did_i is the distance between uu and ii.
  2. The AP algorithm considers every possible distance threshold to classify the nodes as children of uu in the graph GG , and for each threshold jj returns the recall RjR_j and the precision PjP_j . Sorted RjR_j and calculated AP=i=1n(RiRi1)PiAP = \sum_{i=1}^n (R_i − R_{i−1})P_i The Mean Average Precision (mAP) is mAP=1GuGAPumAP= \frac{1}{|G|}\sum_{u∈G} AP_u

A higher mAP means a more efficient embedding when reconstructing the prerequisite relationships of the annotated graph.

0

1

Updated 2020-08-04

Tags

Data Science