Author name: Shikhar Shukla

arXiv:2605.02888v2 Announce Type: replace-cross
Abstract: Speculative decoding accelerates large language model (LLM) inference by using a small draft model to propose candidate tokens that a larger target model verifies. A critical hyperparameter in …

arXiv:2605.02888v1 Announce Type: cross
Abstract: Speculative decoding accelerates large language model (LLM) inference by using a small draft model to propose candidate tokens that a larger target model verifies. A critical hyperparameter in this pro…