L5a. Discrete Memoryless Channels

In this video, we briefly introduce the definition of a discrete memoryless channel along with some illustrative examples. Two concepts are emphasized; the first is the joint pdf of the channel input X and the channel output Y. The second is the evaluation of the marginal pdf of Y given the channel input distribution and the channel transition probabilities. Our objective is to find the capacity of this channel in subsequent videos. References: S. Haykin, Communication Systems, 4th Edition, John Wiley & Sons, 2001 (Chapters 9 and 10) T. Cover and J. Thomas, Elements of Information Theory, John Wiley & Sons, 2006. Lecture notes on information theory and coding: http://apal.naist.jp/~kaji/lecture/ S. M. Moser and P.-N. Chen, A Student’s Guide to Coding and Information Theory, Cambridge, 2012