NAVIGATION
Home
Research
Bookshelf
Garden
FIND ME ON
GitHub
LinkedIn
š±
Let {Xi}i=1ā\{X_{i}\}_{i=1}^{\infty}{Xiā}i=1āā be a memoryless real-valued source, with common pdf fXf_{X}fXā with support SXāRS_{X}\subset \mathbb{R}SXāāR. Then ā1nlogā”2fXn(X1,ā¦,Xn)ānāāE[ālogā”2fX(X)]=h(X)- \frac{1}{n}\log_{2}f_{X^{n}}(X_{1},\ldots,X_{n})\stackrel{ n\to\infty}\to E\left[-\log_{2}f_{X}(X)\right]=h(X)ān1ālog2āfXnā(X1ā,ā¦,Xnā)ānāāE[ālog2āfXā(X)]=h(X)in probability.