Learning Adapter Rank via Symmetry Breaking
arXiv:2506.22809v4 Announce Type: replace-cross
Abstract: Low-rank adaptation is effective partly because downstream updates lie in a low-dimensional subspace, but the latent rank coordinates of LoRA are not identifiable: any invertible reparameteriza…