Annotation Entropy Predicts Per-Example Learning Dynamics in LoRA Fine-Tuning
arXiv:2604.16332v1 Announce Type: new
Abstract: We find that LoRA fine-tuning exhibits un-learning on contested examples: items with high annotator disagreement show increasing loss during training, a qualitatively distinct pattern largely absent unde…