Credits: 3
Information measures and their properties; entropy, relative entropy and mutual information. Information source models. Lossless data compression: the Kraft inequality, Shannon-Fano and Huffman codes. Typical sequences, asymptotic equipartition property, lossy source coding. Discrete memoryless channels: capacity, channel coding theorem. The additive Gaussian channel. Source coding under a fidelity constraint: rate distortion function and rate distortion theorem.
Description
Credit only granted for: ENEE627 or ENEE721.
Formerly: ENEE721.
Additional information: Completing ENEE620 is strongly recommended before taking this course.
Semesters Offered
Spring 2018, Spring 2019, Spring 2020, Spring 2021, Spring 2022, Spring 2023, Spring 2024, Spring 2025, Spring 2026, Spring 2027
Testudo