700.660 (23S) Information Theory and its Application to Communications Engineering
Overview
- Lecturer
- Course title german Information Theory and its Application to Communications Engineering
- Type Lecture - Course (continuous assessment course )
- Course model Attendance-based course
- Hours per Week 2.0
- ECTS credits 4.0
- Registrations 9 (50 max.)
- Organisational unit
- Language of instruction English
- Course begins on 16.06.2023
- eLearning Go to Moodle course
Time and place
Course Information
Intended learning outcomes
Vermittlung von Basiswissen über informationstheoretische Methoden und deren Anwendung in digitalen Übertragungssystemen.
Course content
- Basic definitions: information, entropy, mutual information; entropy for sources with memory.
- Coding for data compression: source coding theorem;
- Lossless data compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, coding for sources with memory.
- Description of noisy communication channels by methods of Information Theory
- Principles of channel coding for reliable communications over noisy channels
- Information theory for continuous random variables: differential entropy, capacity of channels with white and colored noise, bandlimited continuous-time channels
- tradeoff between power and bandwidth efficiency.
- Introduction to Multi-User Information Theory
Literature
lecture notes; broad literature (incl. textbooks) on information theory; e. g.
Thomas, Cover : Elements of Information Theory, 2. Edition, 2006
see: Thomas M. Cover, Joy A. Thomas
Link to further information
https://www.idc.tf.fau.de/person/johannes-huberIntended learning outcomes
The students acquire fundamental insights into information theoretical methods and their application to the assessment and optimization of digital transmission systems.
Course content
- Basic definitions: information, entropy, mutual information; entropy for sources with memory.
- Coding for data compression: source coding theorem;
- Lossless data compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, coding for sources with memory.
- Description of noisy communication channels by methods of Information Theory
- Principles of channel coding for reliable communications over noisy channels
- Information theory for continuous random variables: differential entropy, capacity of channels with white and colored noise, bandlimited continuous-time channels
- tradeoff between power and bandwidth efficiency.
- Introduction to Multi-User Information Theory
Literature
lecture notes; broad literature (incl. textbooks) on information theory; e. g.
Thomas, Cover : Elements of Information Theory, 2. Edition, 2006
see: Thomas M. Cover, Joy A. Thomas
Link to further information
https://www.idc.tf.fau.de/person/johannes-huberExamination information
Examination methodology
30 minutes oral exam, if more than 15 students apply: written, 90 minutes
The date of the exam will be agreed with the students in the last unit
Examination topic(s)
All chapters of the lecture notes
Grading scheme
Grade / Grade grading schemePosition in the curriculum
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Networks and Communications: Advanced (NC)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
- 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (siehe Anhang 2) (
0.0h VO, VK / 30.0 ECTS)
-
Subject: Networks and Communications: Advanced (NC)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
- 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
- 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
- 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 4) (
0.0h VK, VO, KU / 14.0 ECTS)
-
Subject: Information and Communications Engineering: Supplements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 15W.1)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
- 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
-
Wahl aus dem LV-Katalog (Anhang 5) (
0.0h VK, VO, KU / 12.0 ECTS)
-
Subject: Technical Complements (NC, ASR)
(Compulsory elective)
- Master's degree programme Information and Communications Engineering (ICE)
(SKZ: 488, Version: 22W.1)
-
Subject: Networks and Communications: Advanced
(Compulsory elective)
-
1.2 Information Theory (
0.0h VC / 4.0 ECTS)
- 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
-
1.2 Information Theory (
0.0h VC / 4.0 ECTS)
-
Subject: Networks and Communications: Advanced
(Compulsory elective)
Equivalent courses for counting the examination attempts
-
Sommersemester 2021
- 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2018
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2017
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2016
- 700.660 VC Information Theory (2.0h / 4.0ECTS)
-
Sommersemester 2014
- 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)
-
Sommersemester 2013
- 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)