標題: Determining the optimal re-sampling strategy for a classification model with imbalanced data using design of experiments and response surface methodologies
作者: Tong, Lee-Ing
Chang, Yung-Chia
Lin, Shan-Hui
工業工程與管理學系
Department of Industrial Engineering and Management
關鍵字: Re-sampling strategy;Imbalanced data;Classifier;Machine learning;Design of experiments;Response surface methodologies;The area under ROC curve
公開日期: 1-Apr-2011
摘要: Imbalanced data are common in many machine learning applications. In an imbalanced data set, the number of instances in at least one class is significantly higher or lower than that in other classes. Consequently, when classification models with imbalanced data are developed, most classifiers are subjected to an unequal number of instances in each class, thus failing to construct an effective model. Balancing sample sizes for various classes using a re-sampling strategy is a conventional means of enhancing the effectiveness of a classification model for imbalanced data. Despite numerous attempts to determine the appropriate re-sampling proportion in each class by using a trial-and-error method in order to construct a classification model with imbalanced data (Barandela, Vadovinos, Sanchez, & Ferri, 2004; He, Han, & Wang, 2005; Japkowicz, 2000; McCarthy, Zabar, & Weiss, 2005), the optimal strategy for each class may be infeasible when using such a method. Therefore, this work proposes a novel analytical procedure to determine the optimal re-sampling strategy based on design of experiments (DOE) and response surface methodologies (RSM). The proposed procedure, S-RSM, can be utilized by any classifier. Also, C4.5 algorithm is adopted for illustration. The classification results are evaluated by using the area under the receiver operating characteristic curve (AUC) as a performance measure. Among the several desirable features of the AUC index include independence of the decision threshold and invariance to a priori class probabilities. Furthermore, five real world data sets demonstrate that the higher AUC score of the classification model based on the training data obtained from the S-RSM is than that obtained using oversampling approach or undersampling approach. (C) 2010 Elsevier Ltd. All rights reserved.
URI: http://dx.doi.org/10.1016/j.eswa.2010.09.087
http://hdl.handle.net/11536/9099
ISSN: 0957-4174
DOI: 10.1016/j.eswa.2010.09.087
期刊: EXPERT SYSTEMS WITH APPLICATIONS
Volume: 38
Issue: 4
起始頁: 4222
結束頁: 4227
Appears in Collections:Articles


Files in This Item:

  1. 000286904600141.pdf

If it is a zip file, please download the file and unzip it, then open index.html in a browser to view the full text content.