Irrelevant attributes and imbalanced classes in multi-label text-categorization domains

Article type: Research Article

Authors: Dendamrongvit, Sareewan^{; *} | Vateekul, Peerapon | Kubat, Miroslav

Affiliations: Department of Electrical & Computer Engineering, University of Miami, Coral Gables, FL, USA

Correspondence: [*] Corresponding author. E-mail: [email protected].

Abstract: An interesting issue in machine learning is induction in multi-label domains where each example can be labeled with two or more classes at the same time. In a work focusing on text categorization, we followed the most commonly used approach and induced a binary classifier for each class. Analyzing the results, we noticed that performance had been impaired by two factors. First, in text domains, each class is characterized by a different set of attributes; an appropriate attribute-selection technique thus has to be applied separately to each of them. Second, the individual classes often have to be induced from imbalanced training sets, a circumstance we addressed here by majority-class undersampling. The paper provides details of the induction system and reports the results of systematic experimentation.

Keywords: Induction, text categorization, multi-label examples, imbalanced classes

DOI: 10.3233/IDA-2011-0499

Journal: Intelligent Data Analysis, vol. 15, no. 6, pp. 843-859, 2011