Fragile Knowledge, Robust Instruction-Following: The Width Pruning Dichotomy in Llama-3.2
arXiv:2512.22671v2 Announce Type: replace
Abstract: Structured width pruning of GLU-MLP layers, guided by the Maximum Absolute Weight (MAW) criterion, reveals a systematic dichotomy in how reducing the expansion ratio affects different model capabilit…