Source Coding
Uncertainty and information, average mutual information and entropy, information measures for
continuous random variables, source coding theorem, Huffman codes.
Channel Capacity And Coding
Channel models, channel capacity, channel coding, information capacity theorem, The Shannon limit.
Linear And Block Codes For Error Correction
Matrix description of linear block codes, equivalent codes, parity check matrix, decoding of a linear block
code, perfect codes, Hamming codes.
Cyclic Codes
Polynomials, division algorithm for polynomials, a method for generating cyclic codes, matrix description
of cyclic codes, Golay codes.
BCH Codes
Primitive elements, minimal polynomials, generator polynomials in terms of minimal polynomials,
examples of BCH codes.
Convolutional Codes
Tree codes, trellis codes, polynomial description of convolutional codes, distance notions for convolutional
codes, the generating function, matrix representation of convolutional codes, decoding of convolutional
codes, distance and performance bounds for convolutional codes, examples of convolutional codes, Turbo
codes, Turbo decoding.