700.660 (16S) Information Theory
Overview
- Lecturer
- Course title german Information Theory
- Type Lecture - Course (continuous assessment course )
- Hours per Week 2.0
- ECTS credits 4.0
- Registrations 25 (50 max.)
- Organisational unit
- Language of instruction English
- Course begins on 01.03.2016
- Seniorstudium Liberale Yes
Time and place
List of events is loading...
Course Information
Course content
The students acquire fundamental insights into information theoretical methods and their application to the assessment and optimization of digital transmission systems.Topics
- Basic definitions: information, entropy, mutual information;
- Coding for data compression: source coding theorem;
- Lossless compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, entropy and coding for sources with memory.
- Channel coding for reliable communications over noisy channels
- Information theory for continuous random variables: differential entropy, capacity of channels with white and colourd noise, bandlimited contiuous-time channels
- tradeoff between power and bandwidth efficiency.
- Introduction to Rate-Distortion-Theory
Teaching objective
The students acquire fundamental insight into information theoretical methods and their application to the assessment and optimization of digital transmission systems.Prior knowledge expected
Mathematics, Systemtheorie (Signals and Systems)Literature
lecture notes; broad literature (incl. textbooks) on information theory; e. g. Cover, Thomas: Elements of Information Theory, Wiley, 2006Link to further information
http://www.lit.lnt.de/People/Johannes_Huber.shtmlCourse content
The students acquire fundamental insights into information theoretical methods and their application to the assessment and optimization of digital transmission systems.Topics
- Basic definitions: information, entropy, mutual information;
- Coding for data compression: source coding theorem;
- Lossless compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, entropy and coding for sources with memory.
- Channel coding for reliable communications over noisy channels
- Information theory for continuous random variables: differential entropy, capacity of channels with white and colourd noise, bandlimited contiuous-time channels
- tradeoff between power and bandwidth efficiency.
- Introduction to Rate-Distortion-Theory
Teaching objective
The students acquire fundamental insight into information theoretical methods and their application to the assessment and optimization of digital transmission systems.Prior knowledge expected
Mathematics, Systemtheorie (Signals and Systems)Literature
lecture notes; broad literature (incl. textbooks) on information theory; e. g. Cover, Thomas: Elements of Information Theory, Wiley, 2006Link to further information
http://www.lit.lnt.de/People/Johannes_Huber.shtmlExamination information
Im Fall von online durchgeführten Prüfungen sind die Standards zu beachten, die die technischen Geräte der Studierenden erfüllen müssen, um an diesen Prüfungen teilnehmen zu können.
Assessment criteria / Standards of assessment for examinations
schriftlich, 90 Minuten
Assessment criteria / Standards of assessment for examinations
written, 90 minutesGrading scheme
Grade / Grade grading schemePosition in the curriculum
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Networks and Communications: Advanced (NC)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
-
Subject: Networks and Communications: Advanced (NC)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Networks and Communications (WI)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
-
Subject: Networks and Communications (WI)
(Compulsory elective)
- Master's degree programme Information Technology
(SKZ: 489, Version: 06W.3)
-
Subject: Major Field of Specialization (Mobile and Wireless Systems)
(Compulsory subject)
-
1.1-1.3 Lecture with Exercises or Lecture with Seminar (
6.0h VK/VS / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
1.1-1.3 Lecture with Exercises or Lecture with Seminar (
6.0h VK/VS / 12.0 ECTS)
-
Subject: Major Field of Specialization (Mobile and Wireless Systems)
(Compulsory subject)
- Master's degree programme Information Technology
(SKZ: 489, Version: 06W.3)
-
Subject: Technischer Schwerpunkt (Embedded Communications and Signal Processing)
(Compulsory subject)
-
1.1-1.3 Vorlesung mit Kurs oder Vorlesung mit Seminar (
6.0h VK/VS / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
1.1-1.3 Vorlesung mit Kurs oder Vorlesung mit Seminar (
6.0h VK/VS / 12.0 ECTS)
-
Subject: Technischer Schwerpunkt (Embedded Communications and Signal Processing)
(Compulsory subject)
- Master's degree programme Information Technology
(SKZ: 489, Version: 06W.3)
-
Subject: Additional Technical Module I
(Compulsory subject)
-
2.1-2.2 Lecture with Exercises or Lecture with Seminar (
4.0h VK/VS / 8.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
2.1-2.2 Lecture with Exercises or Lecture with Seminar (
4.0h VK/VS / 8.0 ECTS)
-
Subject: Additional Technical Module I
(Compulsory subject)
- Master's degree programme Information Technology
(SKZ: 489, Version: 06W.3)
-
Subject: Additional Technical Module II
(Compulsory subject)
-
3.1-3.3 Lecture with Exercises or Lecture with Seminar (
6.0h VK/VS / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
3.1-3.3 Lecture with Exercises or Lecture with Seminar (
6.0h VK/VS / 12.0 ECTS)
-
Subject: Additional Technical Module II
(Compulsory subject)
- Master's degree programme Technical Mathematics
(SKZ: 401, Version: 13W.1)
-
Subject: Informatik
(Compulsory elective)
-
Ausgewählte Kapitel der Systemsicherheit (
2.0h VK / 4.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Ausgewählte Kapitel der Systemsicherheit (
2.0h VK / 4.0 ECTS)
-
Subject: Informatik
(Compulsory elective)
Equivalent courses for counting the examination attempts
-
Sommersemester 2023
- 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2021
- 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2018
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2017
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2014
- 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2013
- 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)