Soft-TransFormers for Continual Learning
arXiv:2411.16073v3 Announce Type: replace
Abstract: Inspired by the \emph{Well-initialized Lottery Ticket Hypothesis (WLTH)}, we introduce Soft-Transformer (Soft-TF), a parameter-efficient framework for continual learning that leverages soft, real-val…