FIND ME ON

GitHub

LinkedIn

Typical Set

🌱

Definition
InfoTheory

Fix ϵ>0\epsilon>0 and nn, the typical set Aϵ(n)A_{\epsilon}^{(n)} for a CMS with pdf fXf_{X} is given by Aϵ(n)={xnSXn:1nlog2fXn(Xn)h(X)ϵ}A_{\epsilon}^{(n)}=\{x^{n}\in S_{X^{n}}:|- \frac{1}{n}\log_{2}f_{X^{n}}(X^{n})-h(X)|\le\epsilon\}