Affiliations: [a] School of Computer and Artificial Intelligence, Liaoning Normal University, Dalian, Liaoning, China | [b] Information and Communication Engineering Postdoctoral Research Station, Dalian University of Technology, Dalian, Liaoning, China | [c] Postdoctoral Workstation of Dalian Yongjia Electronic Technology Co., Ltd, Dalian, Liaoning, China
Correspondence:
[*]
Corresponding author: Yonggong Ren, School of Computer and Artificial Intelligence, Liaoning Normal University, Dalian, Liaoning, China. E-mail: [email protected].
Abstract: Relation extraction is one of the core tasks of natural language processing, which aims to identify entities in unstructured text and judge the semantic relationships between them. In the traditional methods, the extraction of rich features and the judgment of complex semantic relations are inadequate. Therefore, in this paper, we propose a relation extraction model, HAGCN, based on heterogeneous graph convolutional neural network and graph attention mechanism. We have constructed two different types of nodes, words and relations, in a heterogeneous graph convolutional neural network, which are used to extract different semantic types and attributes and further extract contextual semantic representations. By incorporating the graph attention mechanism to distinguish the importance of different information, and the model has stronger representation ability. In addition, an information update mechanism is designed in the model. Relation extraction is performed after iteratively fusing the node semantic information to obtain a more comprehensive node representation. The experimental results show that the HAGCN model achieves good relation extraction performance, and its F1 value reaches 91.51% in the SemEval-2010 Task 8 dataset. In addition, the HAGCN model also has good results in the WebNLG dataset, verifying the generalization ability of the model.
Keywords: Relation extraction, heterogeneous graph convolution, graph attention, information update
