Two relation mentions are said to be matching only if both the entity mentions match and associated relation types are same.

University of Michigan - Ann Arbor

Evaluation of relation extraction is often done on two levels: Entity Extraction and  Entity+Relation Extraction. 

Evaluation of Relation Extraction

Techniques for Jointly Extracting Entities and Relations: A Survey

Any predicted entity mention is counted as a true positive (TP) if it matches with any of the gold-standard entity mentions in the same sentence. Similarly, for each gold-standard entity mention, if there no matching predicted entity mention in the same sentence, then a false negative (FN) is counted for the gold-standard entity type.

Learn Before

Related