“Noisier” Noise Contrastive Eestimation is (Almost) Maximum Likelihood
arXiv:2405.16730v2 Announce Type: replace-cross
Abstract: Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling. Yet a long-standing challenge remains: accurately estimating ratios between…