Affiliations: School of Computer Science and Technology, Guangdong University of Foreign Studies, Guangzhou, Guangdong, China
Correspondence:
[*]
Corresponding author. Shengyi Jiang, School of Computer Science and Technology, Guangdong University of Foreign Studies, Guangzhou, Guangdong, 510000, China. E-mail: [email protected].
Abstract: Named entity recognition (NER) is fundamental to natural language processing (NLP). Most state-of-the-art researches on NER are based on pre-trained language models (PLMs) or classic neural models. However, these researches are mainly oriented to high-resource languages such as English. While for Indonesian, related resources (both in dataset and technology) are not yet well-developed. Besides, affix is an important word composition for Indonesian language, indicating the essentiality of character and token features for token-wise Indonesian NLP tasks. However, features extracted by currently top-performance models are insufficient. Aiming at Indonesian NER task, in this paper, we build an Indonesian NER dataset (IDNER) comprising over 50 thousand sentences (over 670 thousand tokens) to alleviate the shortage of labeled resources in Indonesian. Furthermore, we construct a hierarchical structured-attention-based model (HSA) for Indonesian NER to extract sequence features from different perspectives. Specifically, we use an enhanced convolutional structure as well as an enhanced attention structure to extract deeper features from characters and tokens. Experimental results show that HSA establishes competitive performance on IDNER and three benchmark datasets.
Keywords: Indonesian, named entity recognition, named entity corpus, structured-attention, residual gated convolution neural network
