Module #2 MTC/Coding

1. Suggested Pre-reqs?

1.1. Probability or STATS

1.2. Programming?

1.3. what level or extent???

2. Readings

2.1. Ch 2, 2.2-2.6, Luenberger

2.2. Ch 3, 3.1 - 3.3, Luenberger

3. Activities/Exercises

3.1. Problem set #1 from HONR 399?

4. Assessment

4.1. Quiz covering learning objectives

5. Development

5.1. M.D. Ward

5.2. B. Ladd

5.3. M. Atwell

5.4. Reviewers

5.4.1. Wojtek

5.4.2. T. Weissman

5.4.3. 1 or more grad students

6. Learning Objectives "what students will be able to do"

6.1. Understand the use of basic probability as related to entropy and information theory

6.2. Calculate and explain what entropy is and how it is used in understanding the communication of information

6.3. Determine average code length

6.4. Be familiar with Shanon's concept of channel capacity

7. Content

7.1. Probability

7.1.1. Intro as related to entropy and coding

7.2. Entropy

7.2.1. definition

7.2.2. how to calculate

7.2.3. how used in coding and communication/information theory

7.3. Coding

7.3.1. length

7.3.2. properties

7.3.3. trees

7.3.4. error correcting codes - another module...

7.4. Channels

7.4.1. Shannon

7.4.2. Discrete

7.4.3. Conditional/Joint

7.4.4. Mutual Information

7.4.5. Capacity