Young Lee and Aditya Menon COMP2610/COMP6261 代写

COMP2610/COMP6261 - Information Theory:

COMP2610/COMP6261 - Information Theory:

Assignment 3

Australian National University

Lecturers: Young Lee and Aditya Menon

Instructions

Marks: This assignment is worth 20% of your overall grade. The maximum marks available

for each question are given in brackets. You must show all your working.

COMP2610 students: Your final mark will be out of 100. You are not expected to

answer the extension questions; further, in this assignment, there will be no bonus points

awarded for answering the extension questions.

COMP6261 students: Your final mark will be out of 110. You are expected to answer

all questions. If your score is x 2 [0; 110], the contribution of this assignment to your final

score is x 100

110

0:2.

Submission: This is an individual assignment. You should submit a typed or scanned copy

of your assignment by uploading a single PDF file to Wattle. The filename should be

UniID.pdf, where UniID is your ANU uni ID (e.g. u1234567). Typing can be in LATEX

(template files provided onWattle) orWord. Scanned copies of handwritten submissions

are acceptable if the handwriting is neat and legible.

Late Penalty: 5% per day overdue (or part thereof), up to 10 days. After 5 PM of 27th October

2016, a mark of 0 will be given (in the absence of medical evidence or other special

permission).

Note: Requests for extensions will not be considered unless made prior to the deadline

and with appropriate reasons and evidence.

Resubmission: The submission site will be open up to 5 PM of 27th October 2016, i.e., 10

days after the deadline. You are allowed to resubmit (upload a new version) as long as

the site is open. After the 17th October deadline, the tutor will grade your submission

by downloading it from Wattle at any arbitrary time, and apply the late penalty (if any)

based on the time stamp of the latest version.

Cheating and Plagiarism: All assignments must be done individually. Remember that plagiarism

is a university offence and will be dealt with according to university procedures.

Please refer to the the corresponding ANU policies:

http://academichonesty.anu.edu.au/UniPolicy.html.

1

COMP2610/6261 Shared Questions

1. (20 pts) LetX be an ensemble withAX = fx1; x2; x3g and probabilitiespX = (1=4; 1=3; 5=12).

(a) (2 pt) Compute the cumulative distribution function F (xi ) for each outcome xi .

(b) (2 pt) Compute the modified distribution function F (xi ) for each outcome xi .

(c) (2 pt) Compute the codeword lengths `(xi ) for each outcome xi .

(d) (3 pt) Compute the (binary) symbol intervals [F (xi