Articlediamond2019

A XGBOOST RISK MODEL VIA FEATURE SELECTION AND BAYESIAN HYPER-PARAMETER OPTIMIZATION

142 citations0/0 files storedInternational Journal of Database Management Systems

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Financial Distress and Bankruptcy Prediction Machine Learning and Data Classification Imbalanced Data Classification Techniques

Abstract

This paper aims to explore models based on the extreme gradient boosting (XGBoost) approach for business risk classification.Feature selection (FS) algorithms and hyper-parameter optimizations are simultaneously considered during model training.The five most commonly used FS methods including weight by Gini, weight by Chi-square, hierarchical variable clustering, weight by correlation, and weight by information are applied to alleviate the effect of redundant features.Two hyper-parameter optimization approaches, random search (RS) and Bayesian tree-structuredParzen Estimator (TPE), are applied in XGBoost.The effect of different FS and hyper-parameter optimization methods on the model performance are investigated by the Wilcoxon Signed Rank Test.The performance of XGBoost is compared to the traditionally utilized logistic regression (LR) model in terms of classification accuracy, area under the curve (AUC), recall, and F1 score obtained from the 10-fold cross validation.Results show that hierarchical clustering is the optimal FS method for LR while weight by Chi-square achieves the best performance in XG-Boost.Both TPE and RS optimization in XGBoost outperform LR significantly.TPE optimization shows a superiority over RS since it results in a significantly higher accuracy and a marginally higher AUC, recall and F1 score.Furthermore, XGBoost with TPE tuning shows a lower variability than the RS method.Finally, the ranking of feature importance based on XGBoost enhances the model interpretation.Therefore, XGBoost with Bayesian TPE hyper-parameter optimization serves as an operative while powerful approach for business risk modeling.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 142 citations exist upstream.

References

2015Taking the Human Out of the Loop: A Review of Bayesian Optimization 2015Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research 1997Credit risk measurement: Developments over the last 20 years 2017A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring 2016Ensemble boosted trees with synthetic features generation in application to bankruptcy prediction 1985Predicting Tender Offer Success: A Logistic Analysis 2011Two credit scoring models based on dual strategy ensemble trees 2009Subagging for credit scoring models

Cited by

2021A Goal Scoring Probability Model for Shots Based on Synchronized Positional and Event Data in Football (Soccer)2021Stock-Price Forecasting Based on XGBoost and LSTM 2023Data-Intensive Inventory Forecasting with Artificial Intelligence Models for Cross-Border E-Commerce Service Automation 2023Forecasting International Stock Market Trends: XGBoost, LSTM, LSTM-XGBoost, and Backtesting XGBoost Models 2025Influence of pedestrianization on travel behavior changes: a case study of Montreal

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.