Where Should LoRA Go? Component-Type Placement in Hybrid Language Models
arXiv:2604.22127v1 Announce Type: new
Abstract: Hybrid language models that interleave attention with recurrent components are increasingly competitive with pure Transformers, yet standard LoRA practice applies adapters uniformly without considering t…