TU Delft
Year
NEDERLANDSENGLISH
Organization
Education Type
Education print this page print this page     
2014/2015 Electrical Engineering, Mathematics and Computer Science Master Embedded Systems
ET4164
Information Theory
ECTS: 4
Responsible Instructor
Name E-mail
Dr.ir. R. Heusdens    R.Heusdens@tudelft.nl
Instructor
Name E-mail
Dr.ir. J.H. Weber    J.H.Weber@tudelft.nl
Contact Hours / Week x/x/x/x
0/3/0/0
Education Period
2
Start Education
2
Exam Period
2
3
Course Language
English
Course Contents
This course explains the basic ideas of information theory and the correspondences between the elements of this theory and certain natural concepts of importance in a wide number of fields, such as transmission, storage, authoring and protection of data. On the basis of simple concepts from probabiliby calculus, models are developed for a discrete information source and a discrete communication channel. Further, the theoretical basics for developing source coding algorithms is provided, as well as the basics of optimal data transmission through a discrete communication channel.

The following topics will be covered:
* (Differential) Entropy, Relative Entropy and Mutual Information
* Asymptotic Equipartition Property
* Data Compression
* Channel Capacity
* Gaussian Channel
* Rate-Distortion Theory
* Network Information Theory

Study Goals
Upon completion of this course the student will understand the fundamentals of Information Theory, which includes the following: (a) the correspondences between the elements of this theory and certain natural concepts of importance in a wide number of fields, such as transmission, storage, authoring and protection of data, (b) core theorems of information theory, (c) the models that are developed for a discrete information source and a discrete communication channel on the basis of simple concepts from probability calculus, (d) how to develop source coding algorithms, and (e) how to secure optimal data transmission through a (noisy) discrete communication channel.
Education Method
lectures
Assessment
written exam