|
|||||||
|
|
|
|||||
|
|
|||||||
98.703 INFORMATION THEORY AND CODING (T) 3-1-0
Module I
Information Theory : Concept of amount of information, units- entropy, marginal, conditional and joint entropies - relation among entropies - mutual information, information rate, channel capacity -redundancy and efficiency of a channel., symmetric channels - binary symmetric channel (BSC), Binary erasure channel (BEC), deterministic and noiseless channels - capacity of bandlimited gaussian channels, Shannon- Hartley theorem - bandwidth - SNR trade off - capacity of a channel of infinite bandwidth, optimum modulation system.
Source coding : Instantaneous codes- construction of instantaneous codes - Kraft's inequality, coding efficiency and redundancy, Noiseless coding theorem - construction of basic source codes - Shannon - Fano Algorithm, Huffman coding.
Module II Codes for error detection & correction - parity check coding - linear block codes - error detecting and correcting capabilities - generator and parity check matrices - Standard array and syndrome decoding - Hamming codes - encoding and decoding, cyclic codes - description - generator and parity check matrices - encoding of cyclic codes - syndrome computation & error detection, decoding of cyclic codes, BCH codes - description & decoding, Reed Solomon Codes, Burst error correction - block and convolutional interleaving.
Module III
Convolutional Codes - encoding - time
and frequency domain approaches, State, Tree & Trellis diagrams - transfer
function and minimum free distance- Maximum likelihood decoding of convolutional
codes - The Viterbi Algorithm, Sequential decoding - Stack Algorithm. ARQ
schemes - Performance of ARQ - Probability of error and throughput.
Cryptography: Secret key cryptography, block and stream ciphers, DES, Public key
cryptography, Diffie - Hellman Public key distribution - RSA system, digital
signatures.
Text Books : -
Module I Module II
1. Ref (1) (ch 10) (1) Ref (5) (ch 3,4,6,9)
2. Ref (2) (ch 13) (2) Ref (4) (ch 12)
3. Ref (3) (ch 5) (3) Ref (1) (ch 11)
4. Ref (4) (ch 8,9,10,11) (4) Ref (3) (ch 4), (5) Ref (2) (ch 13)
Module III
(1) Ref (5) (ch 10,11,12), (2) Ref (4)
(ch 12) ,
(3) Ref (1) (ch 11, Appendix 10), (4) Ref (2) (ch 13), (5)Ref (3) (ch 4)
References : -
1. Simon Haykin. Communication Systems,
3rd ed., John Wiley & Sons Pvt. Ltd.
2. Taub & Schilling. Principles of Communication Systems, 2nd ed.,
TataMcGraw Hill, New Delhi.
3. Das, Mullick & Chatterjee. Principles of Digital Communication, Wiley
Eastern Ltd.
4. Dr. P.S.Sathya Narayana - Probability, Information & Coding theory,
Dynaram Publications, Bangalore.
5. Shu Lin & Daniel J. Costello.Jr., Error Control Coding : Fundamentals and
Applications, Prentice Hall Inc.,Englewood Cliffs, NJ.
Question Paper : -
The question paper will consist of two parts. Part I is to cover the entire syllabus, and carries 40 marks. This will contain 10 compulsory questions of 4 marks each. Part II is to cover 3 modules, and carries 60 marks. There will be 3 questions from each module (10 marks each) out of which 2 are to be answered.