GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Models
arXiv:2604.14262v1 Announce Type: new
Abstract: GUI grounding models report over 85% accuracy on standard benchmarks, yet drop 27-56 percentage points when instructions require spatial reasoning rather than direct element naming. Current benchmarks mi…