700.660 (23S) Information Theory and its Application to Communications Engineering

Sommersemester 2023

Registration deadline has expired.

First course session
16.06.2023 09:00 - 17:00 B04.1.06 On Campus
... no further dates known

Overview

Lecturer
Course title german Information Theory and its Application to Communications Engineering
Type Lecture - Course (continuous assessment course )
Course model Attendance-based course
Hours per Week 2.0
ECTS credits 4.0
Registrations 9 (50 max.)
Organisational unit
Language of instruction English
Course begins on 16.06.2023
eLearning Go to Moodle course

Time and place

List of events is loading...

Course Information

Intended learning outcomes

Vermittlung von Basiswissen über informationstheoretische Methoden und deren Anwendung in digitalen Übertragungssystemen. 

Course content

  • Basic definitions: information, entropy, mutual information; entropy for sources with memory.
  • Coding for data compression: source coding theorem;
  • Lossless data compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, coding for sources with memory.
  • Description of noisy communication channels by methods of Information Theory
  • Principles of channel coding for reliable communications over noisy channels
  • Information theory for continuous random variables: differential entropy, capacity of channels with white and colored noise, bandlimited continuous-time channels
  • tradeoff between power and bandwidth efficiency.
  • Introduction to Multi-User Information Theory

Literature

lecture notes; broad literature (incl. textbooks) on information theory; e. g.

Thomas, Cover : Elements of Information Theory, 2. Edition, 2006

see: Thomas M. Cover, Joy A. Thomas

Link to further information

https://www.idc.tf.fau.de/person/johannes-huber

Intended learning outcomes

The students acquire fundamental insights into information theoretical methods and their application to the assessment and optimization of digital transmission systems.

Course content

  • Basic definitions: information, entropy, mutual information; entropy for sources with memory.
  • Coding for data compression: source coding theorem;
  • Lossless data compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, coding for sources with memory.
  • Description of noisy communication channels by methods of Information Theory
  • Principles of channel coding for reliable communications over noisy channels
  • Information theory for continuous random variables: differential entropy, capacity of channels with white and colored noise, bandlimited continuous-time channels
  • tradeoff between power and bandwidth efficiency.
  • Introduction to Multi-User Information Theory

Literature

lecture notes; broad literature (incl. textbooks) on information theory; e. g.

Thomas, Cover : Elements of Information Theory, 2. Edition, 2006

see: Thomas M. Cover, Joy A. Thomas

Link to further information

https://www.idc.tf.fau.de/person/johannes-huber

Examination information

Im Fall von online durchgeführten Prüfungen sind die Standards zu beachten, die die technischen Geräte der Studierenden erfüllen müssen, um an diesen Prüfungen teilnehmen zu können.

Examination methodology

30 minutes oral exam, if more than 15 students apply: written, 90 minutes

The date of the exam will be agreed with the students in the last unit

Examination topic(s)

All chapters of the lecture notes

Grading scheme

Grade / Grade grading scheme

Position in the curriculum

  • Master's degree programme Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Networks and Communications: Advanced (NC) (Compulsory elective)
      • Wahl aus dem LV-Katalog (siehe Anhang 2) ( 0.0h VO, VK / 30.0 ECTS)
        • 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Information and Communications Engineering: Supplements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 4) ( 0.0h VK, VO, KU / 14.0 ECTS)
        • 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Technical Complements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 5) ( 0.0h VK, VO, KU / 12.0 ECTS)
        • 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Information and Communications Engineering: Supplements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 4) ( 0.0h VK, VO, KU / 14.0 ECTS)
        • 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Technical Complements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 5) ( 0.0h VK, VO, KU / 12.0 ECTS)
        • 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information and Communications Engineering (ICE) (SKZ: 488, Version: 22W.1)
    • Subject: Networks and Communications: Advanced (Compulsory elective)
      • 1.2 Information Theory ( 0.0h VC / 4.0 ECTS)
        • 700.660 Information Theory and its Application to Communications Engineering (2.0h VC / 4.0 ECTS)

Equivalent courses for counting the examination attempts

Sommersemester 2021
  • 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
Sommersemester 2018
  • 700.660 VC Information Theory (2.0h / 4.0ECTS)
Sommersemester 2017
  • 700.660 VC Information Theory (2.0h / 4.0ECTS)
Sommersemester 2016
  • 700.660 VC Information Theory (2.0h / 4.0ECTS)
Sommersemester 2014
  • 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)
Sommersemester 2013
  • 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)