The Rules-and-Facts Model for Simultaneous Generalization and Memorization in Neural Networks
arXiv:2603.25579v1 Announce Type: new
Abstract: A key capability of modern neural networks is their capacity to simultaneously learn underlying rules and memorize specific facts or exceptions. Yet, theoretical understanding of this dual capability rem…