next up previous
Next: Geometric Ergodicity Up: Markov Chain Convergence Previous: Small Sets

Harris Recurrence

Harris recurrence is the property that L(x, A) = 1 for all tex2html_wrap_inline3055 and all tex2html_wrap_inline2523 -positive A, where tex2html_wrap_inline2523 is the stationary distribution. Harris recurrence is a stronger property than tex2html_wrap_inline2523 -irreducibility, which only requires that L(x, A) ;SPMgt; 0 for all x and all tex2html_wrap_inline2523 -positive A, although it can be proved that when a chain is tex2html_wrap_inline2523 -irreducible, there is a tex2html_wrap_inline2523 -null set N such that L(x, A) = 1 does hold for all tex2html_wrap_inline3637 and all tex2html_wrap_inline2523 -positive A. (Meyn and Tweedie, 1993, Proposition 9.0.1).

So the point of Harris recurrence is to banish the pathological null set. It would be very strange if a Markov chain that is an idealization of a computer simulation would be tex2html_wrap_inline2523 -irreducible but not Harris recurrent. If null sets matter when the computer's real numbers are replaced by those of real analysis, then the simulation cannot be well described by the theory.

Fortunately, an irreducible Gibbs or Metropolis sampler is always Harris recurrent under very weak conditions (Tierney, 1994, Corollaries 1 and 2) and the same is true of variable-at-a-time Metropolis-Hastings (Chan and Geyer, 1994, Theorem 1). Because of the general measures employed in the MHG algorithm there can be no such simple theorem implying Harris recurrence for general MHG samplers, but the same principles can sometimes be used to check Harris recurrence for them too.

A different way to prove Harris recurrence uses a so-called drift condition. Recall that for any function V

displaymath3647

The function V is said to be unbounded off small sets if every tex2html_wrap_inline3651 the level set tex2html_wrap_inline3653 is small. We say a Markov chain satisfies the drift condition for recurrence if there exists a function tex2html_wrap_inline3655 which is unbounded off small sets and a small set tex2html_wrap_inline3657 such that

displaymath3659

If a chain satisfies the drift condition for recurrence, then it is Harris recurrent (Meyn and Tweedie, 1993, Theorem 9.1.8).


next up previous
Next: Geometric Ergodicity Up: Markov Chain Convergence Previous: Small Sets

Charles Geyer
Fri Jul 5 15:26:21 CDT 1996