NAVIGATION
Home
Research
Bookshelf
Garden
FIND ME ON
GitHub
LinkedIn
🌱
Given two pmfs ppp and qqq with common support X\mathscr{X}X, and parameter α>0, α≠1\alpha>0, \ \alpha\not=1α>0, α=1, the Renyi divergence of parameter α\alphaα between ppp and qqq is: Dα:=1α−1log2(∑a∈Xpα(a)q1−α(a))D_\alpha:=\frac{1}{\alpha-1}\log_2\left(\sum_{a\in\mathscr{X}}p^\alpha(a)q^{1-\alpha}(a)\right)Dα:=α−11log2(a∈X∑pα(a)q1−α(a))
limα→1Dα(p∥q)=D(p∥q)\lim_{\alpha\to1}D_\alpha(p\|q)=D(p\|q)α→1limDα(p∥q)=D(p∥q)