For a Markov chain{Xi} with alphabetX of size ∣X∣=m and transition matrixQ=Pij, a distribution (or pmf) Π on X is called stationary (or “steady state”) distribution for the MC if ∀a∈XΠ(a)=b∈X∑Π(b)Pij or equivalently in matrix form Π=Π⋅QΠ is row eigenvector of Q with associated eigenvalue 1 (λΠ=Π⋅Q,λ=1) where Π:=(Π1,⋯,Πm)where Πk=Π(xk),k=1,⋯,m,\mboxandX={x1,⋯,xm}
For a finite-alphabet MC (time-invariant), Π always exists. Also, if the MC is irreducible, then Π is unique.