From Tokens to Steps: Verification-Aware Speculative Decoding for Efficient Multi-Step Reasoning
arXiv:2604.15244v1 Announce Type: new
Abstract: Speculative decoding (SD) accelerates large language model inference by allowing a lightweight draft model to propose outputs that a stronger target model verifies. However, its token-centric nature allo…