TIDE: Every Layer Knows the Token Beneath the Context
arXiv:2605.06216v1 Announce Type: new
Abstract: We revisit a universally accepted but under-examined design choice in every modern LLM: a token index is looked up once at the input embedding layer and then permanently discarded. This single-injection …