Title: Over-sampling via under-sampling in strongly imbalanced data

Authors: Rozita Jamili Oskouei; Bahram Sadeghi Bigham

Addresses: Department of Computer Science and Information Technology, Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan, Iran ' Department of Computer Science and Information Technology, Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan, Iran

Abstract: Classification of imbalanced datasets is an important challenge in machine learning. This investigation analysed the effect of ratio imbalance and the selected classifier on the application of several re-sampling strategies to deal with imbalanced datasets. We applied two different classifiers (J48 and Naïve Bayes), four re-sampling algorithms (Org, SMOTE, Borderline SMOTE, OSS and NCL approaches) and four performance assessment measures (TPrate, TNrate, Gmean and AUC) on 13 sets of real data. Our experimental results show that, whenever, datasets are strongly imbalanced, over-sampling methods are more efficient in compare with under-sampling methods. Moreover, our results indicate that, when dealing with imbalanced data with any level, applying re-sampling techniques is preferred. Further, the results indicate that the classifier has very poor influence on the effectiveness of the re-sampling strategies.

Keywords: classification; imbalanced data; minority class; re-sampling strategies; over-sampling; under-sampling; machine learning.

DOI: 10.1504/IJAIP.2017.081179

International Journal of Advanced Intelligence Paradigms, 2017 Vol.9 No.1, pp.58 - 66

Received: 26 Aug 2014
Accepted: 28 Apr 2015
Published online: 26 Dec 2016 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article