Why Mean Pooling Works: Quantifying Second-Order Collapse in Text Embeddings
arXiv:2604.27398v1 Announce Type: new
Abstract: For constructing text embeddings, mean pooling, which averages token embeddings, is the standard approach. This paper examines whether mean pooling actually works well in real models. First, we note that…