Sparse Autoencoders are Topic Models
arXiv:2511.16309v2 Announce Type: replace
Abstract: Sparse autoencoders (SAEs) are used to analyze embeddings, but their role and practical value are debated. We propose a new perspective on SAEs by demonstrating that they can be naturally understood …