Communication Theory

4.1. Probabilistic models for information sources

4.2. Channel probabilistic models

4.3. Channel probabilistic models: The Gaussian channels

4.4. Channel probabilistic models: The digital channels

4.5. Quantitative information measures: Entropy

4.6. Quantitative information measures: Binary Entropy

4.7. Quantitative information measures: Joint and conditional entropies

4.8. Quantitative information measures: Mutual information

4.9. Venn diagram: relationships between information measures

4.10. Differential entropies for continuous random variables