Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA
arXiv:2605.06733v1 Announce Type: cross
Abstract: Federated LoRA enables parameter-efficient adaptation of large language models under decentralized data and limited client resources.However, directly averaging LoRA factors is representation-dependent…