An unsupervised method for automatic validation of verbal phraseological units

Issue title: Special Section: Intelligent and Fuzzy Systems applied to Language & Knowledge Engineering

Guest editors: David Pinto and Vivek Singh

Article type: Research Article

Authors: Sánchez, Belém Priego^{a; *} | Pinto, David^b

Affiliations: [a] Department of Systems, Universidad Autónoma Metropolitana, Unidad Azcapotzalco, CDMX, Mexico | [b] Faculty of Computer Science, Benemérita Universidad Autónoma de Puebla, PUE, Mexico

Correspondence: [*] Corresponding author. Belem Priego Sanchez, Department of Systems, Universidad Autónoma Metropolitana, Unidad Azcapotzalco, Av. San Pablo 180, Col. Reynosa-Tamaulipas, Del. Azcapotzalco, C.P. 02200, CDMX, Mexico. E-mail: [email protected].

Abstract: In this paper we present an unsupervised technique for validating the existence of verbal phraseological units in raw text. This technique employs the concept of internal and contextual attraction which basically considers a mathematical formula based on co-occurrence of terms inside and outside of the terms considered to be part of a verbal phraseological unit. The experiments carried out using a corpus of news stories report a 60% of accuracy, which highlights the challenging task of automatic validation of verbal phraseological units in raw texts.

Keywords: Unsupervised methods, term co-occurrence, phraseological units

DOI: 10.3233/JIFS-179009

Journal: Journal of Intelligent & Fuzzy Systems, vol. 36, no. 5, pp. 4579-4585, 2019