Fast split selection method and its application in decision tree construction from large databases

Issue title: Hybrid Intelligence using rough sets

Article type: Research Article

Authors: Nguyen, Hung Son^{a; *} | Nguyen, Sinh Hoa^b

Affiliations: [a] Institute of Mathematics, Warsaw University, Banacha 2, Warsaw 02-097, Poland | [b] Polish-Japanese Institute of Information Technology, Koszykowa 86, 02-008, Warszawa, Poland

Correspondence: [*] Corresponding author. E-mail: [email protected]

Abstract: We present an efficient method for decision tree construction from large data sets, which are assumed to be stored in database servers, and be accessible by SQL queries. The proposed method minimizes the number of simple queries necessary to search for the best splits (cut points) by employing “divide and conquer” search strategy. To make it possible, we develop some novel evaluation measures which are defined on intervals of attribute domains. Proposed measures are necessary to estimate the quality of the best cut in a given interval. We propose some applications of the presented approach in discretization and construction of “soft decision tree”, which is a novel classifier model.

Keywords: data mining, decision tree, large databases, discernibility measure

DOI: 10.3233/HIS-2005-2205

Journal: International Journal of Hybrid Intelligent Systems, vol. 2, no. 2, pp. 149-160, 2005