t.BA.IT.INCO.13HS (Information Theory and Coding) 
Module: Information Theory and Coding
This information was generated on: 27 October 2021
No.
t.BA.IT.INCO.13HS
Title
Information Theory and Coding
Organised by
T InES
Credits
4

Description

Version: 4.0 start 01 February 2019

 

Short description

This course teaches the basics of digital information processing and coding. Basic digital units, gates and logic are part of it as well as source coding (information, entropy, redundancy) and channel coding methods with error detection and correction.

Module coordinator

Matthias Rosenthal (rosn)

Learning objectives (competencies)

 

Objectives

Competences

Taxonomy levels

General principles:

- Understanding the basic units in computer science (bit, byte, etc.) and their different meanings or value ranges and being proficient in the use of different number systems as well as the representation of numbers and characters.

F, M

K1, K2

Digital technology:

- Understanding the functional logic of digital gates, interpreting schematics and master the realization of simple functions as well as the creation and interpretation of truth tables.

- Knowing and understanding simple combinatorial basic circuits, such as simple adder logics (half-adder, full adder, multiplexer).

- Knowing and understanding simple sequential logic circuits (counter, graycode, registers, shift registers, simple, finite state machines).

F, M

K2

Information theory 1 (source coding):

- Understanding the basic concepts of information theory (information content, entropy) according to Shannon and can calculate entropy for simple examples.

- Understanding the difference between redundancy and irrelevance reduction in source coding and the basic methods of redundancy reduction. You are familiar with the application of the elementary methods for redundancy reduction using simple examples.

F, M

K2, K3

Information theory 2 (channel coding):

- You understand the basics of channel coding for the transmission of binary data. You understand the basic concepts about the use of channel bandwidth according to Nyquist. You know how to calculate the channel capacity according to Shannon.

- You understand the most important methods for error detection and error correction.

- You can define the term Hamming distance.

- You will master the application of the most important error correction methods using simple examples.

F, M

K2, K3

Module contents

General principles:

- Algorithm Concept, Algorithm by Euclid

- Units and basic concepts: Bit, byte, word.

- Complement representation (single and two's complement); arithmetic in the number range; Carry / Borrow / Overflow; Sign Extension

 

Digital technology:

- Logical functions and gates: INV, AND, OR, NAND, NOR, XOR

- Truth table and combinatorial basic circuits: Karnaugh diagrams, half/full adders, subtractors, decoders (e.g. BCD => 7-segment), code conversions, comparator.

- Sequential logic: counter, shift register, simple automaton (traffic light)

 

Information theory:

- Information theory according to Shannon

- Concept of entropy, calculation of entropy

 

Most important methods of source coding:

- Basic concepts: Reduced redundancy and irrelevance, prefix-free codes

- Huffman, arithmetic coding, run length coding, Lempel-Ziv coding, JPEG, MPEG (for MPEG only overview, approaches);

- Overview of the encodings and their fields of application

 

Most important methods of channel coding:

- Channel capacity according to Shannon

- Hamming distance

- Most important methods for error detection (parity, CRC, checksum)

- Error-correcting codes (Hamming code)

- Block code, convolution code (overview)

Teaching materials

 

Supplementary literature

 

Prerequisites

 

Teaching language

(X) German ( ) English

Part of International Profile

( ) Yes (X) No

Module structure

Type 3a

 

For more details please click on this link: T_CL_Modulauspraegungen_SM2025

Exams

 

Description

Type

Form

Scope

Grade

Weighting

Graded assignments during teaching semester

Lab

Own Solution

90 Minutes

5 Labs

20%

End-of-semester exam

Test

Written

90 Minutes

1-6

80%

Remarks

 

Legal basis

The module description is part of the legal basis in addition to the general academic regulations. It is binding. During the first week of the semester a written and communicated supplement can specify the module description in more detail.

 


 

Note

Course: Information und Codierung - Praktikum
No.
t.BA.IT.INCO.13HS.P
Title
Information und Codierung - Praktikum

Note

  • No module description is available in the system for the cut-off date of 01 August 2099.
Course: Information und Codierung - Vorlesung
No.
t.BA.IT.INCO.13HS.V
Title
Information und Codierung - Vorlesung

Note

  • No module description is available in the system for the cut-off date of 01 August 2099.