On confidence intervals from simulation of finite Markov chains

Citation:

Burnetas, A.N. & Katehakis, M.N., 1997. On confidence intervals from simulation of finite Markov chains. Mathematical Methods of Operations Research, 46, pp.241-250.

Abstract:

Consider a finite state irreducible Markov reward chain. It is shown that there exist simulation estimates and confidence intervals for the expected first passage times and rewards as well as the expected average reward, with 100% coverage probability. The length of the confidence intervals converges to zero with probability one as the sample size increases; it also satisfies a large deviations property.

Notes:

cited By 1

Website