Compound Key Word Generation from Document Databases Using A Hierarchical Clustering ART Model

Article type: Research Article

Authors: Muñoz, Alberto^{; 1}

Affiliations: Department of Statistics and Econometrics, University Carlos III, 28903 Getafe, Madrid, España

Note: [1] E-mail: [email protected], URL: http://jupiter.uc3m.es/htdocs/new/estadistica/cv/alberto_munoz.html.

Abstract: The growing availability of databases on the information highways motivates the development of new processing tools able to deal with a heterogeneous and changing information environment. A highly desirable feature of data processing systems handling this type of information is the ability to automatically extract its own key words. In this paper we address the specific problem of creating semantic term associations from a text database. The proposed method uses a hierarchical model made up of Fuzzy Adaptive Resonance Theory (ART) neural networks. First, the system uses several Fuzzy ART modules to cluster isolated words into semantic classes, starting from the database raw text. Next, this knowledge is used together with coocurrence information to extract semantically meaningful term associations. These associations are asymmetric and one-to-many due to the polisemy phenomenon. The strength of the associations between words can be measured numerically. Besides this, they implicitly define a hierarchy between descriptors. The underlying algorithm is appropriate for employment on large databases. The operation of the system is illustrated on several real databases.

Keywords: Automatic indexing, Knowledge extraction, Information retrieval, Neural fuzzy ART models, Information retrieval

DOI: 10.3233/IDA-1997-1103

Journal: Intelligent Data Analysis, vol. 1, no. 1, pp. 25-48, 1997