🌱
Every finite state space Markov chain admits an Invariant probability measure.
Assume is finite and is irreducible. Then must be positive recurrent, and hence has a unique invariant distribution. # Countable state space
For an Irreducible Markov chain with countable , there can be at most one Invariant probability measure.
Let be an atom such that (i.e. positive recurrent) then admits an invariant probability measure.
or
Let be Irreducible, and aperiodic. If is (n-μ)-small for some and (i.e. positive recurrent) then there exists invariant .
or
Let be Harris Recurrent. If is petite and (i.e. positive recurrent) then the Markov chain is Positive Harris Recurrent (and unique invariant ).