NAVIGATION
Home
Research
Bookshelf
Garden
FIND ME ON
GitHub
LinkedIn
Email
Definition (DMS)
A discrete memoryless source (DMS) is an infinite sequence of independent and identically distributed (iid) RVs {Xi}i=1∞={X1,X2,⋯ }\{X_i\}_{i=1}^\infty=\{X_1,X_2,\cdots\}{Xi}i=1∞={X1,X2,⋯}. In particular, all RVs XiX_iXi have a common pmf pXp_XpX defined on X\mathcal{X}X (finite set).
Fixed-Length (Block) Code
Shannon Coding Theorem
Lossy Source-Channel Coding Theorem
Continuous Memoryless Source
Asymptotic Equipartition Property
Entropy Rate
Source Entropy
Stationary & Ergodic Source
Stationary