FoNE: Precise Single-Token Number Embeddings via Fourier Features
arXiv:2502.09741v2 Announce Type: replace-cross
Abstract: Large Language Models (LLMs) typically represent numbers using multiple tokens, which requires the model to aggregate these tokens to interpret numerical values. This fragmentation makes both t…