FIND ME ON

GitHub

LinkedIn

High Resolution Optimality of KLT

🌱

Theorem
InfoTheory

Theorem

The KLT transform for a transform coder is optimal under High-Resolution Conditions, i.e. we assume - X\mathbf{X} is a Gaussian random vector with E[X]=0E[\mathbf{X}]=0 and RX\mathbf{R_{X}} is nonsingular - We maintain the high-resolution approximation to the optimal scalar quantizer is valid with equality - Each QiQ_{i} is the optimal bib_{i}-bit quantizer for YiY_{i} - The bib_{i} are optimally allocated in accordance with the constraint i=1kbiB\sum_{i=1}^{k}b_{i}\le B We also observe that each YiY_{i} is Gaussian since X\mathbf{X} is Gaussian meaning each YiY_{i} has the same shape coefficient: hi=hgh_{i}=h_{g} in the high resolution formula E[(YiY^i)2]=σi2hg22biE[(Y_{i}-\hat{Y}_{i})^{2}]=\sigma_{i}^{2}h_{g}2^{-2b_{i}}where we know from KL Transform Decorrelates X that E[Yi2]=σi2E[Y_{i}^{2}]=\sigma_{i}^{2} and hg=112((12πex2/2)1/3dx)3h_{g}=\frac{1}{12}\left( \int\limits _{-\infty}^{\infty}\left( \frac{1}{\sqrt{ 2\pi }}e^{-x^{2}/2} \right)^{1/3} \, dx \right)^{3} Then for any k×kk\times k orthogonal matrix A\mathbf{A}, we have the following Dtc,ADtc,T=khg22bˉdet(RX)1/kD_{\text{tc},\mathbf{A}}\ge D_{\text{tc},\mathbf{T}}=kh_{g}2^{-2\bar{b}}\det(\mathbf{R_{X}})^{1/k}