Instruction Anchor: Dissecting the Mechanistic Dynamics of Modality Arbitration
arXiv:2602.03677v2 Announce Type: replace
Abstract: Modality following is the ability to selectively leverage multimodal contexts based on user instructions. It is fundamental to the safety and reliability of multimodal large language models (MLLMs) i…