Recency Biased Causal Attention for Time-series Forecasting
arXiv:2502.06151v2 Announce Type: replace
Abstract: Recency bias is a useful inductive prior for sequential modeling: it emphasizes nearby observations and can still allow longer-range dependencies. Standard Transformer attention lacks this property, …