MCMC

Goal of MCMC

Given a pmf π\pi on some state space SS, how do we draw a sample form π\pi or compute the expected value of π\pi (i.e. XπX\sim\pi how do we compute Eπ[X]E_{\pi}[X])? Well we know that:

Linked from