Numerical Problems (Huffman Coding)

Due Date: 24-10-2015

Problem No. 1. Find 1st order Binary Huffman codes for the following. Also determine efficiency of the code.

Letters Probabilities a1 0.2 a2 0.4 a3 0.2 a4 0.1 a5 0.1

Problem No. 2. Find 1st and 2nd order Binary and Tertiary Huffman codes for the following. Determine Efficiency in each case.

Letters Probabilities a1 0.8 a2 0.02 a3 0.18

Problem No. 3. A source emits seven messages with probabilities 1/3, 1/3, 1/9, 1/9, 1/27, 1/27 and 1/27 respectively. Find the entropy of the source. Obtain the compact 3-ary code and find the average length of the code word. Determine the efficiency and the redundancy of the code.