The Randomness Floor: Measuring Intrinsic Non-Randomness in Language Model Token Distributions
arXiv:2604.22771v1 Announce Type: cross
Abstract: Language models cannot be random. This paper introduces Entropic Deviation (ED), the normalised KL divergence between a model’s token distribution and the uniform distribution, and measures it systemat…