Chapter 1 Introduction The fundamental problem of communication is that of reproducing at one point either eractly or approrimately a message selected at another point.-Shannon 1948.Clauide E.Shannon published ap amTo of Com T s paper laid the groundw Information theory studies the transmission,processing and utilization of informa- tion. 1.1 Relationship of information theory and communica tion theory Information theory answers two fundamental questions in communication theory: 1.What is the ultimate data compression?H 2.What is the ultimate transmission rate? Information theoryals cation.(e.g.ra ding 信息理论 通信理论 其木性能图 估计理论 /网络与交 换理论等 信息现论和婚位理论的关系示意图 Shannon理论主要研究基本 通信系统传输的是信号：信号是消息的载体消息中的不确定成分是信息Chapter 1 Introduction The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point. — Shannon In 1948, Claude E. Shannon published a landmark paper entitled “A Mathematical Theory of Communication”. This paper laid the groundwork of a entirely new scientific discipline, “Information Theory”. Information theory studies the transmission, processing and utilization of informa￾tion. 1.1 Relationship of information theory and communica￾tion theory Information theory answers two fundamental questions in communication theory: 1. What is the ultimate data compression? H 2. What is the ultimate transmission rate? C Information theory also suggests means of achieving these ultimate limits of communi￾cation. (e.g. random coding, ML decoding) 网络与交 换理论等 Figure 1.1: 信 息 理 论 和 通 信 理 论 的 关 系 示 意 图. Shannon理 论 主 要 研 究 基 本 限(fundamental limits) 通信系统传输的是信号；信号是消息的载体；消息中的不确定成分是信息。 3