700.660 (18S) Information Theory
Overview
- Lecturer
- Course title german Information Theory
- Type Lecture - Course (continuous assessment course )
- Hours per Week 2.0
- ECTS credits 4.0
- Registrations 12 (50 max.)
- Organisational unit
- Language of instruction English
- possible language(s) of the assessment German
- Course begins on 22.06.2018
- Seniorstudium Liberale Yes
Time and place
List of events is loading...
Course Information
Intended learning outcomes
The students acquire fundamental insights into information theoretical methods and their application tot he assessment and optimization of digital transmission systems.
Course content
- Basic definitions: information, entropy, mutual information;
- Coding for data compression: source coding theorem;
- Lossless compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, entropy and coding for sources with memory.
- Channel coding for reliable communications over noisy channels
- Information theory for continuous random variables: differential entropy, capacity of channels with white and colourd noise, bandlimited contiuous-time channels
- tradeoff between power and bandwidth efficiency.
- Introduction to Rate-Distortion-Theory
Prior knowledge expected
The textbook can be collected in advance from Mrs. Ursula Rotter, Lakeside Park, B02, L2.1.23
Literature
lecture notes; broad literature (incl. textbooks) on information theory; e. g.
Thomas, Cover : Elements of Information Theory, 2. Auflage
Elements of Information Theory 2nd Edition
by: Thomas M. Cover, Joy A. Thomas
(18 July 2006)
Link to further information
http://www.lit.lnt.de/People/Johannes_Huber.shtmlExamination information
Im Fall von online durchgeführten Prüfungen sind die Standards zu beachten, die die technischen Geräte der Studierenden erfüllen müssen, um an diesen Prüfungen teilnehmen zu können.
Examination methodology
written, 90 minutes
Examination topic(s)
Date of the exam is agreed with the students in the last unit
Grading scheme
Grade / Grade grading schemePosition in the curriculum
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Networks and Communications: Advanced (NC)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
-
Subject: Networks and Communications: Advanced (NC)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
- Masterstudium Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information Technology
(SKZ: 489, Version: 06W.3)
-
Subject: Additional Technical Module I
(Compulsory subject)
-
2.1-2.2 Lecture with Exercises or Lecture with Seminar (
4.0h VK/VS / 8.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
2.1-2.2 Lecture with Exercises or Lecture with Seminar (
4.0h VK/VS / 8.0 ECTS)
-
Subject: Additional Technical Module I
(Compulsory subject)
- Master's degree programme Information Technology
(SKZ: 489, Version: 06W.3)
-
Subject: Additional Technical Module II
(Compulsory subject)
-
3.1-3.3 Lecture with Exercises or Lecture with Seminar (
6.0h VK/VS / 12.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
3.1-3.3 Lecture with Exercises or Lecture with Seminar (
6.0h VK/VS / 12.0 ECTS)
-
Subject: Additional Technical Module II
(Compulsory subject)
- Master's degree programme Technical Mathematics
(SKZ: 401, Version: 13W.1)
-
Subject: Informatik
(Compulsory elective)
-
Ausgewählte Kapitel der Systemsicherheit (
2.0h VK / 4.0 ECTS)
- 700.660 Information Theory (2.0h VC / 4.0 ECTS)
-
Ausgewählte Kapitel der Systemsicherheit (
2.0h VK / 4.0 ECTS)
-
Subject: Informatik
(Compulsory elective)
Equivalent courses for counting the examination attempts
-
Sommersemester 2023
- 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2021
- 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2017
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2016
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2014
- 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2013
- 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)