You are here: Course Descriptions


MATH-631 Information Theory (3) Course Level: Graduate

Information Theory (3) The processing, storage, and communication of information, addressing two fundamental questions in the communication and storage of information, namely what are the limits on information compression (the entropy) and what is the best rate of information (the channel capacity). This course develops the mathematical foundations of information theory, including entropy and mutual information, partitioning and equipartitioning, data representation and compression, channel capacity, and dealing with distortion and noise. Usually Offered: fall. Grading: A-F only. Prerequisite: MATH-620.