700.660 (18S) Information Theory

Sommersemester 2018

Registration deadline has expired.

First course session
22.06.2018 09:00 - 17:00 B04.1.06 On Campus
... no further dates known

Overview

Lecturer
Course title german Information Theory
Type Lecture - Course (continuous assessment course )
Hours per Week 2.0
ECTS credits 4.0
Registrations 12 (50 max.)
Organisational unit
Language of instruction English
possible language(s) of the assessment German
Course begins on 22.06.2018
Seniorstudium Liberale Yes

Time and place

List of events is loading...

Course Information

Intended learning outcomes

The students acquire fundamental insights into information theoretical methods and their application tot he assessment and optimization of digital transmission systems.

Course content

  • Basic definitions: information, entropy, mutual information;
  • Coding for data compression: source coding theorem;
  • Lossless compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, entropy and coding for sources with memory.
  • Channel coding for reliable communications over noisy channels
  • Information theory for continuous random variables: differential entropy, capacity of channels with white and colourd noise, bandlimited contiuous-time channels
  • tradeoff between power and bandwidth efficiency.
  • Introduction to Rate-Distortion-Theory

Prior knowledge expected

The textbook can be collected in advance from Mrs. Ursula Rotter, Lakeside Park, B02, L2.1.23

Literature

lecture notes; broad literature (incl. textbooks) on information theory; e. g. 

Thomas, Cover : Elements of Information Theory, 2. Auflage

Elements of Information Theory 2nd Edition 

by: Thomas M. Cover, Joy A. Thomas

 (18 July 2006)

Link to further information

http://www.lit.lnt.de/People/Johannes_Huber.shtml

Examination information

Im Fall von online durchgeführten Prüfungen sind die Standards zu beachten, die die technischen Geräte der Studierenden erfüllen müssen, um an diesen Prüfungen teilnehmen zu können.

Examination methodology

written, 90 minutes

Examination topic(s)

Date of the exam is agreed with the students in the last unit

Grading scheme

Grade / Grade grading scheme

Position in the curriculum

  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Networks and Communications: Advanced (NC) (Compulsory elective)
      • Wahl aus dem LV-Katalog (siehe Anhang 2) ( 0.0h VO, VK / 30.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Information and Communications Engineering: Supplements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 4) ( 0.0h VK, VO, KU / 14.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Technical Complements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 5) ( 0.0h VK, VO, KU / 12.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Information and Communications Engineering: Supplements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 4) ( 0.0h VK, VO, KU / 14.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Masterstudium Information and Communications Engineering (ICE) (SKZ: 488, Version: 15W.1)
    • Subject: Technical Complements (NC, ASR) (Compulsory elective)
      • Wahl aus dem LV-Katalog (Anhang 5) ( 0.0h VK, VO, KU / 12.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information Technology (SKZ: 489, Version: 06W.3)
    • Subject: Additional Technical Module I (Compulsory subject)
      • 2.1-2.2 Lecture with Exercises or Lecture with Seminar ( 4.0h VK/VS / 8.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Master's degree programme Information Technology (SKZ: 489, Version: 06W.3)
    • Subject: Additional Technical Module II (Compulsory subject)
      • 3.1-3.3 Lecture with Exercises or Lecture with Seminar ( 6.0h VK/VS / 12.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)
  • Master's degree programme Technical Mathematics (SKZ: 401, Version: 13W.1)
    • Subject: Informatik (Compulsory elective)
      • Ausgewählte Kapitel der Systemsicherheit ( 2.0h VK / 4.0 ECTS)
        • 700.660 Information Theory (2.0h VC / 4.0 ECTS)

Equivalent courses for counting the examination attempts

Sommersemester 2023
  • 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
Sommersemester 2021
  • 700.660 VC Information Theory and its Application to Communications Engineering (2.0h / 4.0ECTS)
Sommersemester 2017
  • 700.660 VC Information Theory (2.0h / 4.0ECTS)
Sommersemester 2016
  • 700.660 VC Information Theory (2.0h / 4.0ECTS)
Sommersemester 2014
  • 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)
Sommersemester 2013
  • 700.660 VK Information Theory and its Applications in Communication Engineering (2.0h / 4.0ECTS)