next up previous
Next: Small Sets Up: Markov Chain Convergence Previous: Markov Chain Convergence

tex2html_wrap_inline2319 -Irreducibility

Let L(x, A) denote the probability that a Markov chain started at x ever hits the set A. A rather complicated formula for L(x, A) is given by Meyn and Tweedie (1993, p. 72) but is not of interest here.

A Markov chain on a measurable space tex2html_wrap_inline2997 is tex2html_wrap_inline2319 -irreducible if tex2html_wrap_inline2319 is a nonzero measure on tex2html_wrap_inline2997 such that L(x, B) ;SPMgt; 0 for all tex2html_wrap_inline3055 and all tex2html_wrap_inline3041 such that tex2html_wrap_inline3517 . If a chain is tex2html_wrap_inline2319 -irreducible for any tex2html_wrap_inline2319 then it is also tex2html_wrap_inline2523 -irreducible if tex2html_wrap_inline2523 is a stationary distribution for the chain (Meyn and Tweedie, 1993, Proposition 4.4.2 and Theorem 10.4.9), moreover tex2html_wrap_inline2523 must then be the unique stationary distribution. The point of the weaker notion of tex2html_wrap_inline2319 -irreducibility is that it allows one to check fewer sets.

Let tex2html_wrap_inline3531 denote the probability tex2html_wrap_inline3533 that the chain started at x is in B after n steps. Then an equivalent definition of tex2html_wrap_inline2319 -irreducibility is that for every tex2html_wrap_inline3055 and every tex2html_wrap_inline3041 such that tex2html_wrap_inline3517 there exists an n such that tex2html_wrap_inline3551 .



Charles Geyer
Fri Jul 5 15:26:21 CDT 1996