FIND ME ON

GitHub

LinkedIn

Zero Penalty iff Universal Code

🌱

Theorem
InfoTheory

Corollary

A sequence of Shannon-Fano (or arithmetic) codes {Cn}\{ \mathcal{C}_{n} \} obtained from a sequence of coding distributions {qn}\{ q_{n} \} is universal for a source class P\mathcal{P} if and only if lim⁔nā†’āˆž1nD(p∄qn)=0,Ā Ā āˆ€p∈P\lim_{ n \to \infty } \frac{1}{n}D(p\|q_{n})=0, \ \ \forall p\in\mathcal{P}