Young Lee and Aditya Menon COMP2610/COMP6261 代写
COMP2610/COMP6261 - Information Theory:
Assignment 3
Australian National University
Lecturers: Young Lee and Aditya Menon
Instructions
Marks: This assignment is worth 20% of your overall grade. The maximum marks available
for each question are given in brackets. You must show all your working.
COMP2610 students: Your final mark will be out of 100. You are not expected to
answer the extension questions; further, in this assignment, there will be no bonus points
awarded for answering the extension questions.
COMP6261 students: Your final mark will be out of 110. You are expected to answer
all questions. If your score is x 2 [0; 110], the contribution of this assignment to your final
score is x 100
110
0:2.
Submission: This is an individual assignment. You should submit a typed or scanned copy
of your assignment by uploading a single PDF file to Wattle. The filename should be
UniID.pdf, where UniID is your ANU uni ID (e.g. u1234567). Typing can be in LATEX
(template files provided onWattle) orWord. Scanned copies of handwritten submissions
are acceptable if the handwriting is neat and legible.
Late Penalty: 5% per day overdue (or part thereof), up to 10 days. After 5 PM of 27th October
2016, a mark of 0 will be given (in the absence of medical evidence or other special
permission).
Note: Requests for extensions will not be considered unless made prior to the deadline
and with appropriate reasons and evidence.
Resubmission: The submission site will be open up to 5 PM of 27th October 2016, i.e., 10
days after the deadline. You are allowed to resubmit (upload a new version) as long as
the site is open. After the 17th October deadline, the tutor will grade your submission
by downloading it from Wattle at any arbitrary time, and apply the late penalty (if any)
based on the time stamp of the latest version.
Cheating and Plagiarism: All assignments must be done individually. Remember that plagiarism
is a university offence and will be dealt with according to university procedures.
Please refer to the the corresponding ANU policies:
http://academichonesty.anu.edu.au/UniPolicy.html.
1
COMP2610/6261 Shared Questions
1. (20 pts) LetX be an ensemble withAX = fx1; x2; x3g and probabilitiespX = (1=4; 1=3; 5=12).
(a) (2 pt) Compute the cumulative distribution function F (xi ) for each outcome xi .
(b) (2 pt) Compute the modified distribution function F (xi ) for each outcome xi .
(c) (2 pt) Compute the codeword lengths `(xi ) for each outcome xi .
(d) (3 pt) Compute the (binary) symbol intervals [F (xi