Accelerating PayPal’s Commerce Agent with Speculative Decoding: An Empirical Study on EAGLE3 with Fine-Tuned Nemotron Models
arXiv:2604.19767v1 Announce Type: new
Abstract: We evaluate speculative decoding with EAGLE3 as an inference-time optimization for PayPal’s Commerce Agent, powered by a fine-tuned llama3.1-nemotron-nano-8B-v1 model. Building on prior work (NEMO-4-PAYP…