Establishing a Scale for Kullback-Leibler Divergence in Language Models Across Various Settings
arXiv:2505.15353v3 Announce Type: replace
Abstract: Log-likelihood vectors define a common space for comparing language models as probability distributions, enabling unified comparisons across heterogeneous settings. We extend this framework to traini…