Benchmarking Optimizers for MLPs in Tabular Deep Learning
arXiv:2604.15297v2 Announce Type: replace
Abstract: MLP is a heavily used backbone in modern deep learning (DL) architectures for supervised learning on tabular data, and AdamW is the go-to optimizer used to train tabular DL models. Unlike architectur…