Learning neighborhood-based embedding sequence for link prediction in temporal knowledge graphs

Article type: Research Article

Authors: Wang, Liqin^{a; b; c} | Chu, Hang^{a; b; c} | Dong, Yongfeng^{a; b; c; *} | Liu, Enhai^{a; b; c} | Li, Linhao^{a; b; c}

Affiliations: [a] Research Article School of Artificial Intelligence, Hebei University of Technology, Tianjin, China | [b] Hebei Province Key Laboratory of Big Data Computing, Tianjin, China | [c] Hebei Engineering Research Center of Data-Driven Industrial Intelligent, Tianjin, China

Correspondence: [*] Corresponding author. Yongfeng Dong. E-mail: [email protected].

Abstract:  Many real-world knowledge graphs are complex and keep evolving over time. Inferring missing facts in temporal knowledge graphs is a fundamental and challenging task. Previous studies focus on link prediction in static knowledge graphs which hardly extracts the temporal features effectively. In this paper, we propose a novel deep learning model, namely KBGAT-BiLSTM, which is capable of solving long-term predict problems and is suitable for temporal knowledge graph with complex structures. First, we adapt the Graph Attention Network (GAT) to learn the structural features of knowledge graph. Then we utilize the Bidirectional Long Short-Term Memory Networks (BiLSTM) to learn the temporal features and obtain the low-dimensional embeddings of entities and relations. Finally, we employ a scoring function for link prediction in temporal knowledge graphs. Through extensive experiments on YAGO, WIKI, and ICEWS18 datasets, we demonstrate the effectiveness of our model, compare the performance of our model with several different state-of-the-art methods and further analyze the properties of the proposed method.

Keywords: Knowledge graph, link prediction, graph attention network, temporal

DOI: 10.3233/JIFS-210943

Journal: Journal of Intelligent & Fuzzy Systems, vol. 43, no. 6, pp. 7983-7994, 2022