Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation
arXiv:2505.13792v2 Announce Type: replace-cross
Abstract: Recent advances in reasoning-focused Large Language Models (LLMs) have introduced Chain-of-Thought (CoT) traces – intermediate reasoning steps generated before a final answer. These traces, as …