Semantic dependency graph represents the predicate-argument relationship between content words in a sentence ,it also portrays various semantic relationships based on different annotations. The stacked encoders consist of a sequence encoder and a graph encoder, in which the sentence encoder first reads the input text through stacked multi-head self-attention, and then the graph encoder captures semantic relationships and incorporates the semantic graph structure into the contextual-level representation.