Definition (Dirac distribution)
Fix i∈S. Denote δi as the pmf so that δi(j)={10\mboxifj=i\mboxotherwiseδi is known as the Dirac distribution at state i. Thus is RV X has a distribution δi, it means P(X=i)=1In other words, w.p.1. X takes value i.