Information Theory and Coding (Hindi)

   Sunday, May 17, 2020   

Starting a new Lecture Notes Series on Information Theory and Coding

Youtube Lecture Playlist Credits 

Channel Name: Easy Engineering Classes

So Let Us Start to This Journey of Learning
Information Theory and Coding

By Lecture Notes together!

Lecture Description of this above Topic:

Lecture 1: Shannon Fano Encoding Algorithm with Solved Examples

Lecture 2: Shannon Fano Encoding Algorithm - Solved Ambiguity Problem

Lecture 3: Huffman Coding Algorithm – Theory and Solved Example

Lecture 4: Huffman Coding – E.g. of Ternary, Quaternary Coding, Efficiency, Variance

Lecture 5: Error Coding - Block Codes – Introduction, Terms, Formulas

Lecture 6: Error Coding - Block Codes – Single Parity Check Codes with Solved Examples

Lecture 7: Error Coding - Block Codes – Product Codes Theory and Example

Lecture 8: Error Coding - Block Codes – Repetition Codes, Majority Vote Decoding with Example

Lecture 9: Hamming Codes with Example, Hamming Weight, Distance and Minimum Distance

Lecture 10: Linear Codes – Introduction, Properties, Solved Example

Lecture 11: Linear Codes – Generator Matrix, Example to Generate Codewords

Lecture 12: Linear Codes – Systematic Generator Matrix with Solved Examples

Lecture 13: Linear Codes – Parity Check Matrices with Solved Example

Lecture 14: Linear Codes – Error Syndromes with Solved Example

Lecture 15: Cyclic Codes, Polynomials Arithmetic with Examples

Lecture 16: Cyclic Codes, Generator Polynomials, Systematic, Non-Systematic Coding Decoding

Lecture 17: Information Theory and Coding - Definitions, Uncertainty, Properties of Information with Proofs

Lecture 18: Solved Numerical on Information Content

Lecture 19: Entropy Introduction, Properties of Entropy with Proofs

Lecture 20: Entropy Source Efficiency, Redundancy, Information Rate with Solved Numerical’s

Lecture 21: Markoff Statistical Model for Information Sources – Tree Diagram, Solved Numerical

Lecture 22: Communication Channel, Channel Matrix, Joint and Conditional Probability

Lecture 23: Joint Probability Matrix, Properties, Solved Numerical Example

Lecture 24: Binary Communication, Symmetric Channel, System Entropies

Lecture 25: Special Channels – Noiseless, Deterministic and Symmetric Channels with solved example

Lecture 26: Special Channels – Binary Symmetric Channel(BSC) with solved example

Lecture 27: Special Channels – Binary Erasure Channel(BEC) with solved example

Lecture 28: Special Channels – Cascaded Channels with solved example

Lecture 29: Mutual Information, Properties with Solved Numerical

Lecture 30: Proofs of Mutual Information Properties - Information Theory Coding

Lecture 31: Lempel Zip Coding with Solved Numerical Example

Lecture 32: Reed-Solomon Codes – Properties, Advantages, Applications, Generator Polynomial

Lecture 33: BCH Codes – Properties, Generator Polynomial, Solved Example

Lecture 34: Convolutional Codes Introduction – Code Rate, Constraint Length, Code Dimension

Lecture 35: Convolutional Codes - States of the Encoder, Code Tree with Example

Lecture 36: Convolutional Codes Code Trellis, State Diagram, Diff. B/w Code Tree & Code Trellis

Lecture 37: Viterbi Algorithm with Solved Example of Decoding a Code - Convolutional Codes