Intro. IT
Homepage
Syllabus
Homeworks
Project
Lectures
Finals

Homeworks and Solutions

Its crucial to solve the HW exercises in order to understand the matrial in the class.
You may ask friends and use solutions ONLY after you have tried to solve it by yourself and only for checking your answer.
You may also ask me anytime questions about the HW and I would reply them in class at the beginning of the next lecture.

  • HW1 Properties of entropy and mutual information.

  • HW2 Data Compression, Huffman code and AEP.

  • HW3 Channel coding.

  • HW4 Channel coding and differential entropy.

  • HW5 Polar codes.

  • HW6 Machine learning and information mearures

Assignments:

  • Assignment 1 - HW1 - Questions 1-8. For Questions 2-7 you need to read Lecture 1, and for Questions 1 and 8 you also need to read Lecture 2. Due to 8th April.

  • Assignment 2 - HW1 - Questions 9, 10, 17, and 22. HW2 - Qusetions 1-3. Due to 16th April.

  • Assignment 3 - HW1 - Questions 14, 24, and 25. HW2 - Qusetions 4-7, and 12. Due to 25th April.

  • Assignment 4 - HW2 - Questions 8. 9, 13 (first, read pages 6–9 in Lecture 5, which includes a section on source coding with side information), and Question 18. Due to 8th May.