Electrical and Electronic Engineering The University of Western Australia

Content: The topics covered include basic concepts of information theory--entropy, mutual information, channel capacity, information rate, Shannon's noiseless coding theorem and Shannon's fundamental coding theorem; modelling of information sources--zero-memory and Markov models; modelling of information channels--BSC and BEC channels, additivity of information and cascaded channels; construction of compact source codes--Kraft inequality, compact codes, Huffman and LZW compression codes; and analysis and design of error-control channel codes--Hamming distance, binary linear codes and the parity-check matrix, Hamming codes, checksum codes, cyclic codes and the generator polynomial and CRC codes.