NAVIGATION
Home
Research
Bookshelf
Garden
FIND ME ON
GitHub
LinkedIn
Email
Definition (Source entropy)
For a DMS, the source entropy, H(X)H(X)H(X) or H(X1)H(X_{1})H(X1) is defined as the entropy of any one of its RVs since they are all iid (H(X)=H(Xi) ∀iH(X)=H(X_{i}) \ \forall iH(X)=H(Xi) ∀i).
Shannon Coding Theorem
Stationary & Ergodic Source