Journal of Risk Model Validation

Risk.net

Performance validation of representative sample-balancing methods in loan credit-scoring scenarios

Ling-Jia Chen and Runchi Zhang

  • 12 of the most representative sample-balancing methods are validated quantitively.
  • The paper finds that all balanced methods can meet the stability requirements of the regulatory authorities.
  • It is argued that the balancing ratio needs to be properly set to achieve better performance.
  • Balancing with more related variables will enhance the performance and robustness for most methods.

Data sets used to construct a credit-scoring model are always imbalanced in the real world, leading to the recognition ability of the model becoming biased toward the majority and low-risk samples and away from the minority and high-risk samples. In the past few decades, many sample-balancing methods have been designed to balance the two classes of samples before modeling, but they lack sufficient performance verification, especially on large data sets. This paper quantitatively validates 12 of the most representative balancing methods. The results show that, in terms of performance, a method combining the synthetic minority oversampling technique (SMOTE) and the Edited Nearest Neighbor method is optimal, followed by the SMOTE-Tomek method, whose performance is significantly different from the other methods tested. All 12 balanced methods can maintain stability and thus meet the relevant requirements of the regulatory authorities. The performance of each credit-scoring model is also influenced by the balancing ratio and the number of variables in the data set. In general, the user needs to determine the proper balancing ratio according to the comprehensive characteristics of the scoring model and the balancing method, and a data set containing a larger number of related variables will improve the performance and robustness for most balancing methods.

Sorry, our subscription options are not loading right now

Please try again later. Get in touch with our customer services team if this issue persists.

New to Risk.net? View our subscription options

You need to sign in to use this feature. If you don’t have a Risk.net account, please register for a trial.

Sign in
You are currently on corporate access.

To use this feature you will need an individual account. If you have one already please sign in.

Sign in.

Alternatively you can request an individual account here