Improving information retrieval system performance by combining different text-mining techniques

Article type: Research Article

Authors: Mandala, Rila^a | Tokunaga, Takenobu^b | Tanaka, Hozumi^b

Affiliations: [a] Department of Informatics, Institute of Technology Bandung, Jalan Ganesha 10, Bandung 40132, Indonesia. E-mail [email protected] | [b] Department of Computer Science, Tokyo Institute of Technology, 2-12-1 Oookayama Meguro-Ku, Tokyo 152-8554, Japan. E-mail: [email protected], [email protected]

Abstract: WordNet, a hand-made, general-purpose, and machine-readable thesaurus, has been used in information retrieval research by many researchers, but failed to improve the performance of their retrieval system. Thereby in this paper we investigate why the use of WordNet has not been successful. Based on this analysis we propose a method of making WordNet more useful in information retrieval applications by combining it with other knowledge resources. A simple word sense disambiguation is performed to avoid misleading expansion terms. Experiments using several standard information retrieval test collections show that our method results in a significant improvement of information retrieval performance. Failure analysis were done on the cases in which the proposed method fail to improve the retrieval effectiveness. We found that queries containing negative statements and multiple aspects might cause problems in the proposed method and we also investigated the solution to these problems.

Keywords: text-mining, information retrieval, thesaurus

DOI: 10.3233/IDA-2000-4604

Journal: Intelligent Data Analysis, vol. 4, no. 6, pp. 489-511, 2000