Created by Knut M. Synstadfrom the Noun Project

Irreducible

Definition (μ-irreducible)

A Markov chain is μ\mu-irreducible if for any BB(X)B\in\mathcal{B}(\mathbb{X}) with positive measure μ(B)>0\mu(B)>0 and any xXx\in\mathbb{X}, n>0\exists n>0 s.t. Pn(x,B)>0P^{n}(x,B)>0i.e. P(xt+nBxt=x)>0\mathbb{P}(x_{t+n}\in B\mid x_{t}=x)>0 there exists some finite path to any state with any initial state with positive probability.

Remark

Lebesgue-irreducible     λ(B)>0\iff\lambda(B)>0

Definition (Irreducible (474))

A Markov chain {Xi}\{X_i\} is called irreducible if one can go from any state value in X\mathcal{X} to any other state value in X\mathcal{X} in a finite number of transitions with positive probability, i.e., a,bX\mboxandi1, t1\mboxs.t.P(Xt+i=bXi=a)>0\forall a,b\in\mathcal{X} \mbox{ and } i\ge1, \ \exists t\ge1\mbox{ s.t. }P(X_{t+i}=b|X_{i}=a)>0 or “you can reach any other state from every state (no closed loops)”.

Definition (Irreducible (455))

We say a transition matrix PP is irreducible if for any i,jSi,j\in S, iji\leftrightarrow jThat is, SS is a single communicating class. We will also say that the Markov chain is irreducible.

Definition (Maximal Irreducible Measure)

A measure ψ\psi is a maximal μ-irreducible measure if μ\forall\mu s.t. {Xi}i=1\{ X_{i} \}_{i=1}^{\infty} is μ-irreducible then μψ\mu \ll \psi (i.e. μ\mu is absolutely continuous w.r.t. ψ\psi) or ψ is maximal irreducible mesaure    μψ, μ μ-irredudible\psi \text{ is maximal irreducible mesaure}\iff\mu\ll \psi, \ \forall\mu \ \mu\text{-irredudible}

Linked from