Spark Policy Toolkit: Semantic Contracts and Scalable Execution for Policy Learning in Spark
arXiv:2604.25061v1 Announce Type: cross
Abstract: Custom policy-learning pipelines in Spark fail for two coupled systems reasons: rowwise Python execution makes inference impractical, and driver-side candidate materialization makes split search fragil…