Enabling Performant and Flexible Model-Internal Observability for LLM Inference
arXiv:2605.11093v1 Announce Type: new
Abstract: Today’s inference-time workloads increasingly depend on timely access to a model’s internal states. We present DMI-Lib, a high-speed deep model inspector that treats internal observability as a first-cla…