**MATH 474**

**Information Theory**

**Units: 3.00**

Topics include: information measures, entropy, mutual information, modeling of information sources, lossless data compression, block encoding, variable-length encoding, Kraft inequality, fundamentals of channel coding, channel capacity, rate-distortion theory, lossy data compression, rate-distortion theorem. Given jointly with MATH 874.

**Learning Hours:**140 (36 Lecture, 104 Private Study)

**Offering Faculty:**Faculty of Arts and Science