Definition (Renyi Entropy)
Given parameter α>0, α=1, a RV X∼pX, then the Renyi entropy with parameter α is Hα(X)=1−α1log2(a∈X∑pX(a)α)=1−ααlog2(∥pX∥α) where ∥pX∥α is the “α-norm of pX” or ∥pX∥α=[a∈X∑pX(a)α]α1
Lemma (Renyi Entropy reduces to Entropy)
α→1limHα(X)=H(X)