Octopus: History-Free Gradient Orthogonalization for Continual Learning in Multimodal Large Language Models
arXiv:2605.14938v1 Announce Type: new
Abstract: Continual learning in multimodal large language models (MLLMs) aims to sequentially acquire knowledge while mitigating catastrophic forgetting, yet existing methods face inherent limitations: architectur…