MATH 874 Information Theory
An introduction to the fundamental principles of the theory of communication. Topics include: information measures, entropy, mutual information, divergence; modeling of information sources, discrete memoryless sources, Markov sources, entropy rate, source redundancy; fundamentals of lossless data compression, block encoding, variable-length encoding, Kraft inequality, design of Shannon-Fano and Huffman codes; fundamentals of channel coding, channel capacity, noisy channel coding theorem, channels with memory, lossless information transmission theorem; continuous-alphabet sources and channels, differential entropy, capacity of discrete-time and band-limited continuous-time Gaussian channels; rate-distortion theory, lossy data compression, rate-distortion theorem, lossy information transmission theorem. Offered jointly with MATH-474). Three term hours, fall; lectures.
Mathematics and Statistics
https://www.queensu.ca/academic-calendar/graduate-studies/programs-study/mathematics-statistics/
The Department of Mathematics and Statistics is located in its own building, Jeffery Hall. Graduate students are provided with study space in Jeffery Hall and most classes and seminars are scheduled in the building.
Mathematics and Statistics (MATH)
https://www.queensu.ca/academic-calendar/graduate-studies/courses-instruction/math/
The department offers a selection of courses from the following list each academic year. Course offerings for the current academic year can be found on the Department of Mathematics and Statistics website .
Academic Programs
https://www.queensu.ca/academic-calendar/arts-science/academic-programs/
...at any level. The MATH and STAT Joint...855 ; SURP 870 ; SURP 874 ; iv. Up to...
Computing
https://www.queensu.ca/academic-calendar/graduate-studies/programs-study/computing/
...PREREQUISITES: a 100-level math course; some programming...of the School. CISC 874 Neural and Cognitive...
Computing and Information Science (CISC)
https://www.queensu.ca/academic-calendar/graduate-studies/courses-instruction/cisc/
...PREREQUISITES: a 100-level math course; some programming...of the School. CISC 874 Neural and Cognitive...