Locally application of cascade generalization for classification problems

Article type: Research Article

Authors: Kotsiantis, S.

Affiliations: Department of Mathematics, University of Patras, P.A. Box: 1399, University of Patras, Patra 26500, Greece. Tel.: +30 2610 997833; Fax: +30 2610 997313; E-mail: [email protected]

Abstract: Numerous machine learning problems involve an investigation of relationships between features in heterogeneous datasets, where different classifier can be more appropriate for different regions. We propose a technique of localized cascade generalization of weak classifiers. This technique identifies local regions having similar characteristics and then uses the cascade generalization of local experts to describe the relationship between the data characteristics and the target class. We performed a comparison with other well known combining methods using weak classifiers as base-learners, on standard benchmark datasets and the proposed technique was more accurate.

Keywords: Machine learning, data mining, classification, ensembles of classifiers

DOI: 10.3233/IDT-2008-2405

Journal: Intelligent Decision Technologies, vol. 2, no. 4, pp. 239-246, 2008