CS/ECE/Math 729, Information Theory - Fall 2018
3619 Engineering Hall, 303 Van Vleck
Telephone: 265-3817, 263-4753.
Office Hours: M 3-4 in 3619 EH, W 2-3 in 3619 EH, or Th 1:30-2:30 in 303 VV, or by appointment.
Elements of Information Theory, Second Edition, by Thomas M. Cover and Joy A. Thomas, available free online through Wiley Online Library.
Ed Witten on Information Theory
Probability distributions and maximum entropy
Definition of measures of information and their properties, capacity of discrete and continuous channels with noise, source and channel coding theorems, fundamentals of channel coding, noiseless source coding, and source coding with a fidelity criterion. Enroll Info: ECE 331 or Math 431 or cons inst
- Main Lecture: MWF, 9:55-10:45, 2239 Engineering Hall.
The HW will be worth 10%, each midterm 20%, and the final 50% of your grade.
If you score 90% or higher, you will get an A; if you score 80% or higher, you will at least get a B;
if you score 70% or higher, you will at least get a C; if you score 60% or higher, you will at least
get a D.
Homework will be set most Fridays and be due the following Friday (in class- I will not go looking for or accept homeworks
in my mailboxes and offices around campus). You are encouraged to discuss
the exercises with your classmates but the work you hand in should be your own.
- HW1, due Fri, Sep 14
- HW2, due Fri, Sep 21
- HW3, due Fri, Sep 28
- HW4, due Fri, Oct 5
- HW5, due Fri, Oct 19
- HW6, due Fri, Oct 26
- HW7, due Fri, Nov 2
- HW8, due Fri, Nov 9
- HW9, due Fri, Nov 30
- HW10, due Fri, Dec 7
Midterms will be in class on Friday, Oct 12, and Friday, Nov 16. If you have a McBurney visa, then please meet
me as soon as possible (certainly at least two weeks before the 1st midterm) so I can arrange accommodation.
- Final - 7:25pm, Monday, December 17, in 2540 EH.