Homeworks and Solutions

Its crucial to solve the HW exercises in order to understand the matrial in the class.
You may ask friends and use solutions ONLY after you have tried to solve it by yourself and only for checking your answer.
You may also ask me anytime questions about the HW and I would reply them in class at the beginning of the next lecture.

HW1 Properties of entropy and mutual information.
HW2 Data Compression, Huffman code and AEP.
HW3 Channel coding.
HW4 Channel coding and differential entropy.
HW5 Polar codes.

Assignments (expected 10 assignments):

Assignment 1 - HW1: questions 1-6 and 22. Due to Tuesday 4th April.

Assignment 2 - HW1: questions 11, 14, and 17. HW2: questions 1-5. Due to Friday 14th April.

Assignment 3 - HW2: questions 6, 7, 12, 16, 18. Due to Thursday 20th April.

Assignment 4 - K-nearest neighbours. Solve HW1 KNN Python small version on ML website. Due to Thursday 4th May.

Assignment 5 - Linear regression. Solve Linear Regression with Python on ML website. Due to Monday 22nd May.

Assignment 6 - Sigmoid and Neural Networks: feedforward and backpropagation. Solve HW4 on ML website. Due to Sunday 28th May.

Assignment 7 - HW2: questions 8-10, and 13. HW3 questions 1-3. Due to Sunday 5th June.
Assignment 8 - HW3: questions 4-7. Due to Wednesday 14th June.
Assignment 9 - HW5: question 1. Due to Tuesday 27th June.