3-1 Measures of Random Syntactic Information Shannon Theory of Information Key point: 1. Information is something that can be used to remove uncertainty. 2. The amount of information can then be measured by the amount of uncertainty it removed. 3. In the cases of communications, only waveform is concerned while meaning and value are ignored. 4. Uncertainty and thus information are statistic in nature and statistical mathematics is enough
1. Information Processing Definition of Information processing All operations exerted to the information itself for its better utilization Information processing is necessary because most of the information in its original form may not be good for use. Thus information processing is the basis of later operations Two categories of information processing: 1)Shallow Level of Information Processing 2)Deeper level of Information Processing
1 Fundamentals of Control Theory N. Wiener: Control theory in engineering, whether it is Concerned with Man, animal or machine, can only be regarded as a part of the theory of information [(G) Controller