Correcting Auto-Differentiation in Neural-ODE Training
arXiv:2306.02192v3 Announce Type: replace
Abstract: Does the use of auto-differentiation yield reasonable updates for deep neural networks (DNNs)? Specifically, when DNNs are designed to adhere to neural ODE architectures, can we trust the gradients p…