Homeworks and Solutions

Its crucial to solve the HW exercises in order to understand the matrial in the class.
You may ask friends and use solutions ONLY after you have tried to solve it by yourself and only for checking your answer.
You may also ask me anytime questions about the HW and I would reply them in class at the beginning of the next lecture.

  • HW1 Properties of entropy and mutual information.

  • HW2 Data Compression, Huffman code and AEP.

  • HW3 Channel coding.

  • HW4 Channel coding and differential entropy.

  • HW5 Polar codes.

  • HW6 Machine learning and information mearures

Assignments:

  • Assignment 1 - HW1: Questions 1-4 and 6-8. Due on Wednesday, April 8.

  • Assignment 2 - HW1: Questions 9,10,11,17, and 22. Due on Thursday, April 23.

  • Assignment 3 - HW2: Questions 1-5. Due on Thursday, May 07.

  • Assignment 4 - HW2: Questions 6-9 and 12. Due on Sunday, May 24.

  • Assignment 5 - HW2: Questions 13, 15, and 17. HW3: Questions 1-5. Due on Thursday, May 28.