FIND ME ON

GitHub

LinkedIn

Optimal Compressor

🌱

Theorem
InfoTheory

Theorem

Given the pdf ff, the compressor G:R→(0,1)G:\mathbb{R}\to(0,1) which minimizes D(QG,N)ā‰ˆB212N2āˆ«āˆ’āˆžāˆžf(x)G′(x)2 dxD(Q_{G,N})\approx \frac{B^{2}}{12N^{2}}\int\limits _{-\infty}^{\infty} \frac{f(x)}{G'(x)^{2}} \, dxis determined by G′(x)=f(x)1/3āˆ«āˆ’āˆžāˆžf(y)1/3 dyG'(x)=\frac{f(x)^{1/3}}{\int\limits _{-\infty}^{\infty}f(y)^{1/3} \, dy }For the (asymptotically) optimal companding scheme using this GG D(QG,N)ā‰ˆ112N2(āˆ«āˆ’āˆžāˆžf(x)1/3 dx)3D(Q_{G,N})\approx \frac{1}{12N^{2}}\left( \int\limits _{-\infty}^{\infty} f(x)^{1/3} \, dx \right)^{3}

Intuition

This can essentially be thought of as the optimal N-level quantizer.