Achievability of the Rate Distortion Function

Achievable

Arithmetic-Geometric Mean Inequality

Average Code Rate

Average Probability of Error (Channel Code)

Average Probability of Error (Source-Channel Code)

Binary Erasure Channel

Binary Symmetric Channel

Binary Symmetric Erasure Channel

Bit Allocation Problem

Code Rate

Codebook

Codeword

Dirichlet Mixture Distribution

Discrete Communication Channel

Discrete Memoryless Channel

Distortion

Distortion Measure

Distortion Rate Function

Divergence Bound on KT

Fixed-Length (Block) Code

Fixed-Length Codes for Discrete Channels

Gain of Transform Coding

Gaussian Rate Distortion Function

Gaussian Source Maximizes Rate Distortion Function

Hadamard's Inequality

Hamming Distortion

Hamming Rate Distortion Function

High Resolution Optimality of KLT

Huffman Lemma

Information Capacity

Joint AEP

Kac's Lemma (Stationary Ergodic)

Karhunen-Loeve Transform

KL Transform Decorrelates X

Kraft Inequality for UD VLCs

Krichevsky and Trofimov Coding Distribution

Lagrange Multiplier

Lempel-Ziv Coding

Lossless Joint Source-Channel Coding Theorem

Lossy Source-Channel Coding Theorem

Max Redundancy on KT

Mean Squared Error Distortion

Nonsingular Code

Number of Types

Operational Channel Capacity

Optimal Bit Allocation

Optimal Distortion

Penalty Lemma

Prefix Code

Prefix Code Redundancy

Probability of Decoding Error

Probability Simplex

R(D) is Convex in D

Rate

Rate Distortion Function

Rate Distortion Theorem

Redundancy

Reproduction

Set of Types with Denominator n

Shannon Coding Theorem

Shannon Limit

Shannon-Fano-Elias Code

Shannon's Channel Coding Theorem for the DMC

Simplification of the Norm

Size of Type Class

Source-Channel Fixed-Length Code

Symmetric Channel

Tangent Plane for LM

Transform Coding Distortion

Transform Coding with Scalar Quantization

Type

Type Class

Uniquely Decodable

Universal Code

Universal Code PMF Q

Variable Length Code

Zero Penalty iff Universal Code