700.660 (16S) Information Theory

Sommersemester 2016

Registration deadline has expired.

First course session
17.06.2016 09:00 - 18:00 L4.1.01 Off Campus
... no further dates known

Overview

Lecturer
Course title german Information Theory
Type Lecture - Course (continuous assessment course )
Hours per Week 2.0
ECTS credits 4.0
Registrations 25 (50 max.)
Organisational unit
Language of instruction English
Course begins on 01.03.2016
Seniorstudium Liberale Yes

Time and place

List of events is loading...

Course Information

Course content

The students acquire fundamental insights into information theoretical methods and their application to the assessment and optimization of digital transmission systems.

Topics

  • Basic definitions: information, entropy, mutual information;
  • Coding for data compression: source coding theorem;
  • Lossless compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, entropy and coding for sources with memory.
  • Channel coding for reliable communications over noisy channels
  • Information theory for continuous random variables: differential entropy, capacity of channels with white and colourd noise, bandlimited contiuous-time channels
  • tradeoff between power and bandwidth efficiency.
  • Introduction to Rate-Distortion-Theory

Teaching objective

The students acquire fundamental insight into information theoretical methods and their application to the assessment and optimization of digital transmission systems.

Prior knowledge expected

Mathematics, Systemtheorie (Signals and Systems)

Literature

lecture notes; broad literature (incl. textbooks) on information theory; e. g. Cover, Thomas: Elements of Information Theory, Wiley, 2006

Link to further information

http://www.lit.lnt.de/People/Johannes_Huber.shtml

Course content

The students acquire fundamental insights into information theoretical methods and their application to the assessment and optimization of digital transmission systems.

Topics

  • Basic definitions: information, entropy, mutual information;
  • Coding for data compression: source coding theorem;
  • Lossless compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, entropy and coding for sources with memory.
  • Channel coding for reliable communications over noisy channels
  • Information theory for continuous random variables: differential entropy, capacity of channels with white and colourd noise, bandlimited contiuous-time channels
  • tradeoff between power and bandwidth efficiency.
  • Introduction to Rate-Distortion-Theory

Teaching objective

The students acquire fundamental insight into information theoretical methods and their application to the assessment and optimization of digital transmission systems.

Prior knowledge expected

Mathematics, Systemtheorie (Signals and Systems)

Literature

lecture notes; broad literature (incl. textbooks) on information theory; e. g. Cover, Thomas: Elements of Information Theory, Wiley, 2006

Link to further information

http://www.lit.lnt.de/People/Johannes_Huber.shtml

Examination information

Im Fall von online durchgeführten Prüfungen sind die Standards zu beachten, die die technischen Geräte der Studierenden erfüllen müssen, um an diesen Prüfungen teilnehmen zu können.

Assessment criteria / Standards of assessment for examinations

schriftlich, 90 Minuten

Assessment criteria / Standards of assessment for examinations

written, 90 minutes

Grading scheme

Grade / Grade grading scheme

Position in the curriculum

  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Networks and Communications: Advanced (NC) (Compulsory elective)
      • Wahl aus dem LV-Katalog (siehe Anhang 2) ( 0.0h VO, VK / 30.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Information and Communications Engineering: Supplements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 4) ( 0.0h VK, VO, KU / 14.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Technical Complements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 5) ( 0.0h VK, VO, KU / 12.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Information and Communications Engineering: Supplements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 4) ( 0.0h VK, VO, KU / 14.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Technical Complements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 5) ( 0.0h VK, VO, KU / 12.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Networks and Communications (WI) (Compulsory elective)
      • Wahl aus dem LV-Katalog (siehe Anhang 2) ( 0.0h VO, VK / 30.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information Technology (SKZ: 489, Version: 06W.3)
    • Subject: Major Field of Specialization (Mobile and Wireless Systems) (Compulsory subject)
      • 1.1-1.3 Lecture with Exercises or Lecture with Seminar ( 6.0h VK/VS / 12.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information Technology (SKZ: 489, Version: 06W.3)
    • Subject: Technischer Schwerpunkt (Embedded Communications and Signal Processing) (Compulsory subject)
      • 1.1-1.3 Vorlesung mit Kurs oder Vorlesung mit Seminar ( 6.0h VK/VS / 12.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information Technology (SKZ: 489, Version: 06W.3)
    • Subject: Additional Technical Module I (Compulsory subject)
      • 2.1-2.2 Lecture with Exercises or Lecture with Seminar ( 4.0h VK/VS / 8.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information Technology (SKZ: 489, Version: 06W.3)
    • Subject: Additional Technical Module II (Compulsory subject)
      • 3.1-3.3 Lecture with Exercises or Lecture with Seminar ( 6.0h VK/VS / 12.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Master's degree programme Technical Mathematics (SKZ: 401, Version: 13W.1)
    • Subject: Informatik (Compulsory elective)
      • Ausgewählte Kapitel der Systemsicherheit ( 2.0h VK / 4.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)

Equivalent courses for counting the examination attempts

Sommersemester 2023
  • 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
Sommersemester 2021
  • 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
Sommersemester 2018
  • 700.660 VC Information Theory (2.0h / 4.0ECTS)
Sommersemester 2017
  • 700.660 VC Information Theory (2.0h / 4.0ECTS)
Sommersemester 2014
  • 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)
Sommersemester 2013
  • 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)