LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis
arXiv:2510.24561v2 Announce Type: replace-cross
Abstract: LoRA has become a widely adopted method for PEFT, and its initialization methods have attracted increasing attention. However, existing methods have notable limitations: many methods do not inc…