TU Delft
Year
NEDERLANDSENGLISH
Organization
Education Type
Education print this page print this page     
2017/2018 Electrical Engineering, Mathematics and Computer Science Master Electrical Engineering
EE4560
Information Theory
ECTS: 5
Responsible Instructor
Name E-mail
Dr.ir. R. Heusdens    R.Heusdens@tudelft.nl
Instructor
Name E-mail
Dr.ir. J.H. Weber    J.H.Weber@tudelft.nl
Contact Hours / Week x/x/x/x
0/0/4/0
Education Period
3
Start Education
3
Exam Period
3
4
Course Language
English
Course Contents
This course explains the basic ideas of information theory and the correspondences between the elements of this theory and certain natural concepts of importance in a wide number of fields, such as transmission, storage, authoring and protection of data. On the basis of simple concepts from probabiliby calculus, models are developed for a discrete information source and a discrete communication channel. Further, the theoretical basics for developing source coding algorithms is provided, as well as the basics of optimal data transmission through a discrete communication channel.

The following topics will be covered:
* (Differential) Entropy, Relative Entropy and Mutual Information
* Asymptotic Equipartition Property
* Data Compression
* Channel Capacity
* Gaussian Channel
* Rate-Distortion Theory
* Network Information Theory
Study Goals
Upon completion of this course the student will understand the fundamentals of Information Theory, which includes the following: (a) the correspondences between the elements of this theory and certain natural concepts of importance in a wide number of fields, such as transmission, storage, authoring and protection of data, (b) core theorems of information theory, (c) the models that are developed for a discrete information source and a discrete communication channel on the basis of simple concepts from probability calculus, (d) how to develop source coding algorithms, and (e) how to secure optimal data transmission through a (noisy) discrete communication channel.
Education Method
lectures + mini project
Assessment
Written exam + evaluation of the mini project