🌱
Let be a discrete random variable with range . The pmf of is the function defined by:
Prior
Shannon Coding Theorem
Shannon-Fano-Elias Code
Type
Divergence Bound on KT
Penalty Lemma
Universal Code PMF Q
Joint AEP
Cross-Entropy
Discrete Memoryless Source
Divergence
Entropy
Jensen-Shannon Divergence
Renyi Divergence
Stationary & Ergodic Source
Stationary Distribution
Typical Set
Asymptotic Equipartition Property
Convexity or Concavity of Information Measure
Channel Coding Operation
Expectation
Variance
Expectation of a Function of a Random Variable
Conditional Probability Mass Function
Joint Probability Mass Function
Marginal Probability Mass Function
Probability Mass Function
Binomial Random Variable
Geometric Random Variable
Negative Binomial RV
Poisson Random Variable
Detailed Balance
Markov chain
MCMC
Monte Carlo Method
Dirac Distribution