3, H(X) Analysis: Source Coding Source Encoder For being a ble to express the amount of information of a source with H(X), the encoder with an average length, L of codes should keep the relation as below: (X) p(暮)logp()<l p(x dl n=1 Otherwise, distortion will unavoidably be introduced Thus, the optimal coding is the one with3, H(X) Analysis: Source Coding For being able to express the amount of information of a source with H(X), the encoder with an average length, l, of codes should keep the relation as below: Otherwise, distortion will unavoidably be introduced. H(X) = - p(x ) log p(x ) < l = p(x ) l Thus, the optimal coding is the one with Source Encoder X Y n n - n=1 N - n=1 N n n