The Override Gap: A Magnitude Account of Knowledge Conflict Failure in Hypernetwork-Based Instant LLM Adaptation
arXiv:2604.23750v1 Announce Type: cross
Abstract: Hypernetwork-based methods such as Doc-to-LoRA internalize a document into an LLM’s weights in a single forward pass, but they fail systematically on conflicts: when the document contradicts pretrainin…