Jordan-RoPE: Non-Semisimple Relative Positional Encoding via Complex Jordan Blocks
arXiv:2605.04217v1 Announce Type: new
Abstract: Relative positional encodings determine which functions of query-key lag can enter the primitive attention logit. RoPE supplies a rotary phase, while ALiBi supplies an additive distance bias. Motivated b…