NAVIGATION
Home
Research
Bookshelf
Garden
FIND ME ON
GitHub
LinkedIn
š±
For a DMS, the source entropy, H(X)H(X)H(X) or H(X1)H(X_{1})H(X1ā) is defined as the entropy of any one of its RVs since they are all iid (H(X)=H(Xi)Ā āiH(X)=H(X_{i}) \ \forall iH(X)=H(Xiā)Ā āi).
Shannon Coding Theorem
Stationary & Ergodic Source