math.PR, math.ST, stat.ML, stat.TH

Central Limit Theorems for Transition Probabilities of Controlled Markov Chains

arXiv:2508.01517v3 Announce Type: replace-cross
Abstract: We develop a central limit theorem (CLT) for a non-parametric estimator of the transition matrices in controlled Markov chains (CMCs) with finite state-action spaces. Our results establish prec…