Kraft Inequality

Theorem (Kraft Inequality)

A set of positive integers {l1,,lM}\{\mathscr{l}_{1},\cdots,\mathscr{l}_{M}\} is said to satisfy the Kraft inequality with base DD (where D2D\ge2 integer) if i=1MDli1\sum\limits_{i=1}^{M}D^{-\mathscr{l}_{i}}\le1

Theorem (Kraft Inequality for Uniquely Decodably VLCs)

Let C\mathcal{C} be a UD DD-ary n-th order VLC for a discrete source {Xi}i=1\{X_i\}_{i=1}^\infty with alphabet X\mathcal{X} and let l1,,lM\mathscr{l}_{1},\cdots,\mathscr{l}_{M} be the lengths of the code’s M=XMM=|\mathcal{X}|^M codewords. Then these codeword lengths satisfy the Kraft Inequality with base DD i=1MDli1\sum\limits_{i=1}^{M}D^{-\mathscr{l}_{i}}\le1

Linked from