T18: Optimal Coding and Arithmetic Coding. Differential Entropy.

24 Novembro 2017, 10:00 Paulo Alexandre Carreira Mateus

Optimal coding: Huffman codes and their optimality. Shannon-Fano-Elias coding and its efficient implementation: arithmetic coding.

 Information theoretic quantities for continuous random variables: differerential entropy (marginal, conditional, and joint). Kullback-Leibler divergence, the information inequality and its corollaries. Lecturer: Mario Figueiredo.