Academic Calendar 2023-2024

Search Results

MATH 874 Information Theory

MATH 874  Information Theory  Units: 3.00  

An introduction to the fundamental principles of the theory of communication. Topics include: information measures, entropy, mutual information, divergence; modeling of information sources, discrete memoryless sources, Markov sources, entropy rate, source redundancy; fundamentals of lossless data compression, block encoding, variable-length encoding, Kraft inequality, design of Shannon-Fano and Huffman codes; fundamentals of channel coding, channel capacity, noisy channel coding theorem, channels with memory, lossless information transmission theorem; continuous-alphabet sources and channels, differential entropy, capacity of discrete-time and band-limited continuous-time Gaussian channels; rate-distortion theory, lossy data compression, rate-distortion theorem, lossy information transmission theorem.   Offered jointly with MATH-474).  Three term hours, fall; lectures.

Offering Faculty: Faculty of Arts and Science  

Mathematics and Statistics

The Department of Mathematics and Statistics is located in its own building, Jeffery Hall. Graduate students are provided with study space in Jeffery Hall and most classes and seminars are scheduled in the building.

Mathematics and Statistics (MATH)

The department offers a selection of courses from the following list each academic year.  Course offerings for the current academic year can be found on the  Department of Mathematics and Statistics website . 

Academic Programs any level. The MATH and STAT Joint...855 ; SURP 870 ; SURP 874 ; iv. Up to...


...PREREQUISITES: a 100-level math course; some programming...of the School. CISC 874 Neural and Cognitive...

Computing and Information Science (CISC)

...PREREQUISITES: a 100-level math course; some programming...of the School. CISC 874 Neural and Cognitive...