(n-μ)-small

Accessible

Aperiodic

Atom

Chapman Kolmogorov Equation

Communication

Construction of Invariant measure

Continuous Time Markov Chain

Convergence to Equilibrium

Detailed Balance

Dobrushin's Ergodic Coefficient

Equivalent Bounds

Ergodic Theorem

Existence of Invariant measure

Feller condition for invariant measure

Foster-Lyapunov Theorems

Harris Recurrent

Indistinguishable

Invariant Distribution

Invariant Distribution ↔ Positive Recurrence

Invariant Distribution for CTMC

Invariant Measure

Invariant probability measure

Irreducible

Joint Markov Chain

Kac's Lemma

Markov chain

Markov Property

MCMC

Metropolis Hastings Algorithm

Monte Carlo Method

Moving from small to petite sets

Null Recurrence

Petite Set

Positive Harris Recurrent

Positive Recurrent

Q-Matrix

Recurrent

Stationary

Transient

Transition Kernel

Uniquely Ergodic

Uniqueness of invariant measure