|
Lectures Notes
Scheduled lectures:
Lecture 1: Definition of entropy and mutual information[pdf]
Lecture 2: Convexity and properties of divergence[pdf]
Lecture 3: Prefix/Instantaneous codes [pdf]
Proof of Kraft inequality for non finite alphabet [pdf][tex]
Lecture 4: Optimality of Huffman Code, Uniqely decodeable code, AEP [pdf][tex]
Lecture 5: AEP and fixed-length lossless source coding [pdf]
Channel coding definitions [pdf]
Lecture 6: Channel coding [pdf]
Example: Binarry Erasure Channel [pdf]
Optimality of Source Channel coding seperation [pdf]
Lecture 7: Differential entropy and Gaussian Channel [pdf]
Lecture 8: Gaussian Channel [pdf]
Lecture 9: Geometric intuition for the Gaussian channel and channel state information [pdf]
Maximum Entropy princeple, channel information [pdf]
Lecture 10: MIMO[pdf]
Lecture 11: Rate distorstion [pdf]
Lecture 12: Polar codes
Part A: [pdf]
Part B: [pdf]
Part C (Compression using polar codes): [pdf]
Lectures on Network coding:
Lecture A: Defintions of relay network coding (one source-one destination), and upper bounds and achievability [pdf]
Lecture B: Network coding with multiple sources and a determinstic algorithm [pdf]
Lecture C: Finite fields [pdf]
Appendix:
Cheating sheet- A summary of the equations [pdf]
Appendix 1- Introduction to Probability and stochastic processes [pdf]
Appendix 2- Introduction to convex analisys [pdf]
Appendix 3- Introduction to analisys [pdf]
Appendix 4- Noatation [pdf]
Appendix 5- Law of large numbers [pdf]
Instruction on how to scribe the lectures:
Here are some tips on how to write a good paper/lecture.
The lectures should be scribed in English using Latex.
The format should be as in Lecture 1. (The best way is to download the sources of Lecture 1 and to modify lec1.tex file)
Each lecture should include all the results (and their proofs) presented in the class. Additional meterial added by the students is welcome too.
The scribing may be done in pairs or by single students.
Scribing a lecture is not mandatory; however a student or a pair of student who will scribe a lecture will get up to 7 point bonus to the final grade.
Students are encouraged to add figures to the lecture notes. Figures need to be in an EPS format (figures may be generated by Inkscape, Visio,
xfig or any other drawing program). Please include the source file of the figure.
The notation should be as in class. We use the same notation as in Cover's textbooks, with only one difference: we denote pmf as $P(x)$ or $P_X(x)$ rather than $p(x)$.
In order to write in latex one needs three components
Those who do not want to install latex can connect to the server Faraday (supported by our department) using a remote desktop.
It already has Winedt, Miktex and Ghostscript.
Useful links:
|