For DMC (X,Y,Q=[Pij]) with information capacity C=pXmaxI(X;Y)its operational capacity Cop satisfies Cop=C i.e. the following two results hold: 1. Forward Part (Achievability): For any 0<ϵ<1, there exists γ=γ(ϵ)>0 and a sequence of (n,Mn) fixed-length codes Cn for the DMC with C>n→∞liminfn1log2Mn≥C−γand Pe(Cn)<ϵfor n sufficiently large. 2. Converse Part: For any sequence of (n,Mn) fixed-length codes Cn for the DMC with n→∞liminfn1log2Mn>C we have that n→∞limPe(Cn)>0or that Pe(Cn) cannot asymptotically vanish (i.e. if our rate exceeds the channel capacity, we do not get low error of probability).
Given a DMC (X,Y,Q=[Pij]) with arbitrary input word Xn resulting in output word Yn, then I(Xn;Yn)≤nCwhere C:=maxpXI(X;Y) is the channel’s information capacity.