L1. Introduction To Information Theory and Coding

Course Objective: The aim of this course is to introduce the undergraduate students to the fundamental concepts in information theory and coding and to indicate where and how the theory can be applied. Focus will be on interpretation of results. Try to avoid complex proofs of some theorems. In this lecture, we Explain the course objectives List the subjects to be covered Provide a general description of a digital communication system Model the additive white Gaussian noise and its effect on error rate in transmission Introduce the term: system reliability Introduce the term: system efficiency References: S. Haykin, Communication Systems, 4th Edition, John Wiley & Sons, 2001 (Chapters 9 and 10) T. Cover and J. Thomas, Elements of Information Theory, John Wiley & Sons, 2006. G. A. Jones and J. M. Jones, “Information and Coding Theory,” Springer ISBN 1-85233-622-6, 3rd Edition. R. W. Hamming, Coding and Information Theory, 2nd Ed., Prentice-Hall Inc.,1986 R. B. Wells, Applied Coding & Information Theory for Engineers, Prentice Hall, NJ 1999. R. E. Ziemer and W. H. Tranter, Principles of Communications: Systems, Modulation, and Noise, 6th Edition, Hoboken, NJ : Wiley, 2009. S. M. Moser and P.-N. Chen, A Student’s Guide to Coding and Information Theory, Cambridge, 2012. Information Theory Class Notes: at http://apal.naist.jp/~kaji/lecture/