Causal Drawbridges: Characterizing Gradient Blocking of Syntactic Islands in Transformer LMs
arXiv:2604.13950v1 Announce Type: new
Abstract: We show how causal interventions in Transformer models provide insights into English syntax by focusing on a long-standing challenge for syntactic theory: syntactic islands. Extraction from coordinated v…