cs.LG, math.OC, stat.ML

Gradient Regularized Newton Boosting Trees with Global Convergence

arXiv:2605.00581v1 Announce Type: new
Abstract: Gradient Boosting Decision Trees (GBDTs) dominate tabular machine learning, with modern implementations like XGBoost, LightGBM, and CatBoost being based on Newton boosting: a second-order descent step in…