Efficient Rationale-based Retrieval: On-policy Distillation from Generative Rerankers based on JEPA
arXiv:2604.23336v1 Announce Type: cross
Abstract: Unlike traditional fact-based retrieval, rationale-based retrieval typically necessitates cross-encoding of query-document pairs using large language models, incurring substantial computational costs. …