700.660 (17S) Information Theory
Overview
- Lecturer
- Course title german Information Theory
- Type Lecture - Course (continuous assessment course )
- Hours per Week 2.0
- ECTS credits 4.0
- Registrations 18 (50 max.)
- Organisational unit
- Language of instruction Englisch
- Course begins on 23.06.2017
- Seniorstudium Liberale Yes
Time and place
List of events is loading...
Course Information
Intended learning outcomes
The students acquire fundamental insights into information theoretical methods and their application tot he assessment and optimization of digital transmission systems.
Course content
- Basic definitions: information, entropy, mutual information;
- Coding for data compression: source coding theorem;
- Lossless compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, entropy and coding for sources with memory.
- Channel coding for reliable communications over noisy channels
- Information theory for continuous random variables: differential entropy, capacity of channels with white and colourd noise, bandlimited contiuous-time channels
- tradeoff between power and bandwidth efficiency.
- Introduction to Rate-Distortion-Theory
Literature
lecture notes; broad literature (incl. textbooks) on information theory; e. g. Cover, Thomas: Elements of Information Theory, Wiley, 2006
Link to further information
http://www.lit.lnt.de/People/Johannes_Huber.shtmlExamination information
Im Fall von online durchgeführten Prüfungen sind die Standards zu beachten, die die technischen Geräte der Studierenden erfüllen müssen, um an diesen Prüfungen teilnehmen zu können.
Examination methodology
written, 90 minutes
Grading scheme
Grade / Grade grading schemePosition in the curriculum
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Networks and Communications: Advanced (NC)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
-
Subject: Networks and Communications: Advanced (NC)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information Technology
(SKZ: 489, Version: 06W.3)
-
Subject: Additional Technical Module I
(Compulsory subject)
-
2.1-2.2 Lecture with Exercises or Lecture with Seminar (
4.0h VK/VS / 8.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
2.1-2.2 Lecture with Exercises or Lecture with Seminar (
4.0h VK/VS / 8.0 ECTS)
-
Subject: Additional Technical Module I
(Compulsory subject)
- Master's degree programme Information Technology
(SKZ: 489, Version: 06W.3)
-
Subject: Additional Technical Module II
(Compulsory subject)
-
3.1-3.3 Lecture with Exercises or Lecture with Seminar (
6.0h VK/VS / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
3.1-3.3 Lecture with Exercises or Lecture with Seminar (
6.0h VK/VS / 12.0 ECTS)
-
Subject: Additional Technical Module II
(Compulsory subject)
- Master's degree programme Technical Mathematics
(SKZ: 401, Version: 13W.1)
-
Subject: Informatik
(Compulsory elective)
-
Ausgewählte Kapitel der Systemsicherheit (
2.0h VK / 4.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Ausgewählte Kapitel der Systemsicherheit (
2.0h VK / 4.0 ECTS)
-
Subject: Informatik
(Compulsory elective)
Equivalent courses for counting the examination attempts
-
Sommersemester 2025
- 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2023
- 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2021
- 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2018
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2016
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2014
- 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2013
- 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)