A new mutual information based measure for feature selection

Article type: Research Article

Authors: Al-Ani, Ahmed | Deriche, Mohamed | Chebil, Jalel

Affiliations: Signal Processing Research Centre, Queensland University of Technology, GPO Box 2434, Brisbane, Q 4001, Australia. E-mail: [email protected], [email protected], [email protected]

Abstract: In this paper, we discuss the problem of feature selection and the importance of using mutual information in evaluating the discrimination ability of feature subsets between class labels. Because of the difficulties associated with estimating the exact value of mutual information, we propose a new evaluation measure that is based on the information gain and takes into consideration the interaction between features. The proposed measure is integrated into a robust feature selection scheme and compared with the well-known mutual information feature selection (MIFS) algorithm using the problems of texture classification, speech segment classification and speaker identification.

Keywords: feature selection, filter evaluation function, information measure

DOI: 10.3233/IDA-2003-7105

Journal: Intelligent Data Analysis, vol. 7, no. 1, pp. 43-57, 2003