Affiliations: [a] College of Light Industry and Food Engineering, Nanjing Forestry University, Nanjing, Jiangsu, China | [b] College of Information Science and Technology, Nanjing Forestry University, Nanjing, Jiangsu, China | [c] Beijing Key Laboratory of Big Data Technology for Food Safety, Beijing Technology and Business University, Beijing, China | [d] College of Light Industry and Food Engineering, Nanjing Forestry University, Nanjing, Jiangsu, China
Correspondence:
[*]
Corresponding author: Dehong Xie, College of Information Science and Technology, Nanjing Forestry University, Nanjing, Jiangsu 210037, China. Email: [email protected].
Abstract: Synthetic Minority Oversampling Technique (SMOTE) and some extensions based on it are popularly used to balance imbalanced data. In this study, we concentrate on solving overfitting of the classification model caused by choosing instances to oversample that increase the occurrence of overlaps with the majority class. Our method called Clustering-based Improved Adaptive Synthetic Minority Oversampling Technique (CI-ASMOTE1) decomposes minority instances into sub-clusters according to their connectivity in the feature space and then selects minority sub-clusters which are relatively close to the decision boundary as the candidate regions to oversample. After application of CI-ASMOTE1, new minority instances are only synthesized within each connected region of the selected sub-clusters. Considering the diversity of the synthetic instances in each selected sub-cluster, CI-ASMOTE2 is put forward to extend CI-ASMOTE1 by keeping all features of those instances in the feature space as different as possible. The experimental evaluation shows that CI-ASMOTE1 and CI-ASMOTE2 improve SMOTE and its extensions, especially in the occurrence of overlaps between the minority instances and the majority instances.
Keywords: Imbalanced data classification, clustering, oversampling, overfitting
