Homeworks and Solutions

Its crucial to solve the HW exercises in order to understand the matrial in the class.
You may ask friends and use solutions ONLY after you have tried to solve it by yourself and only for checking your answer.
You may also ask me anytime questions about the HW and I would reply them in class at the beginning of the next lecture.

HW1 Properties of entropy and mutual information.
HW2 Data Compression, Huffman code and AEP.
HW3 Channel coding.
HW4 Channel coding and differential entropy.
HW5 Polar codes.
HW6 Machine learning and information mearures

Assignments:

Assignment 1 - HW1 - Questions 1-8. For Questions 2-7 you need to read Lecture 1, and for Questions 1 and 8 you also need to read Lecture 2. Due by 8th April.
Assignment 2 - HW1 - Questions 9, 10, 17, and 22. HW2 - Qusetions 1-3. Due by 16th April.
Assignment 3 - HW1 - Questions 14, 24, and 25. HW2 - Qusetions 4-7, and 12. Due by 25th April.
Assignment 4 - HW2 - Questions 8. 9, 13 (first, read pages 6–9 in Lecture 5, which includes a section on source coding with side information), and Question 18. Due by 8th May.
Assignment 5 - Solve Linear Regression for Python homework (python file link) on ML website. Due by 21st May via Moodle.
Assignment 6 - Solve Logistic Regression for Python homework on ML website. Due by 28th May via Moodle.
Assignment 7 - HW3 - Questions 1-8, and 12. Due by 4th June via Moodle.