Less Is More: Engineering Challenges of On-Device Small Language Model Integration in a Mobile Application
arXiv:2604.24636v1 Announce Type: cross
Abstract: On-device Small Language Models (SLMs) promise fully offline, private AI experiences for mobile users (no cloud dependency, no data leaving the device). But is this promise achievable in practice? This…