NAVIGATION
Home
Research
Bookshelf
Garden
FIND ME ON
GitHub
LinkedIn
🌱
Fix i∈Si\in Si∈S. Denote δi\delta_iδi as the pmf so that δi(j)={1\mboxifj=i0\mboxotherwise\delta_i(j)=\left\{ \begin{array}{ll} 1 & \mbox{if }j=i\\ 0 & \mbox{otherwise} \end{array}\right.δi(j)={10\mboxifj=i\mboxotherwiseδi\delta_iδi is known as the Dirac distribution at state iii. Thus is RV XXX has a distribution δi\delta_iδi, it means P(X=i)=1P(X=i)=1P(X=i)=1In other words, w.p.1. XXX takes value iii.
Markov Property