Semester:
Spring of every year
Credits:
Total Credits: 3 Lecture/Recitation/Discussion Hours: 3
Description:
Shannon information measures. Uniqueness theorem and chain rules of the entropy measures. Kullback-Leibler relative-entropy. The I-measure. Asymptotic Equipartition Property (AEP) for various sources. Channel capacity; discrete-memoryless and symmetric channels. The channel coding theorem. Rate-distortion theory. Applications of coding to modern communications and compression methods such as image
Semester:
Fall of odd years
Credits:
Total Credits: 3 Lecture/Recitation/Discussion Hours: 3
Description:
Shannon information measures. Uniqueness theorem and chain rules of the entropy measures. Kullback-Leibler relative-entropy. The I-measure. Asymptotic Equipartition Property (AEP) for various sources. Channel capacity; discrete-memoryless and symmetric channels. The channel coding theorem. Rate-distortion theory. Applications of coding to modern communications and compression methods such as image