Scalable AI Inference: Performance Analysis and Optimization of AI Model Serving
arXiv:2604.20420v1 Announce Type: new
Abstract: AI research often emphasizes model design and algorithmic performance, while deployment and inference remain comparatively underexplored despite being critical for real-world use. This study addresses th…