Importance-Guided Basis Selection for Low-Rank Decomposition of Large Language Models
arXiv:2605.01627v1 Announce Type: new
Abstract: Low-rank decomposition is a compelling approach for compressing large language models, but its effectiveness hinges on selecting which singular-vector bases to retain for a target task. Existing methods …