NAVIGATION
Home
Research
Bookshelf
Garden
FIND ME ON
GitHub
LinkedIn
š±
A discrete memoryless source (DMS) is an infinite sequence of independent and identically distributed (iid) RVs {Xi}i=1ā={X1,X2,āÆā}\{X_i\}_{i=1}^\infty=\{X_1,X_2,\cdots\}{Xiā}i=1āā={X1ā,X2ā,āÆ}. In particular, all RVs XiX_iXiā have a common pmf pXp_XpXā defined on X\mathcal{X}X (finite set).
Fixed-Length (Block) Code
Shannon Coding Theorem
Joint AEP
Lossy Source-Channel Coding Theorem
Continuous Memoryless Source
Entropy Rate
Source Entropy
Stationary & Ergodic Source
Stationary
Typical Set
Asymptotic Equipartition Property