Sampling Sampling provides a discrete-time representation of a continuous waveform Sample points are real-valued numbers In order to transmit over a digital system we must first convert into discrete valued numbers
Information content of a random variable Random variable x Outcome of a random experiment Discrete R V takes on values from a finite set of possible outcomes PMF: P(X=y)=Py) How much information is contained in the event X=y? Will the sun rise today Revealing the outcome of this experiment provides no information Will the Celtics win the NBa championship? Since this is unlikely, revealing yes provides more information than revealing Events that are less likely contain more information than likely events
