LOFT: Low-Rank Orthogonal Fine-Tuning via Task-Aware Support Selection
arXiv:2605.11872v1 Announce Type: cross
Abstract: Orthogonal parameter-efficient fine-tuning (PEFT) adapts pretrained weights through structure-preserving multiplicative transformations, but existing methods often conflate two distinct design choices:…