Here are some additional problems for "Elements of Information Theory".
We are always looking for new problems, so if you have any interesting ones, please
send it to us.
The problems below are available in three formats. Clicking on the links
below will show you the HTML version of the prolems. At the end of each
chapter are links to the Latex and Postscript versions of the same problems.
- Entropy, Relative
Entropy and Mutual Information
- The Asymptotic
Equipartition Property
- Entropy Rate
of a Stochastic Process
- Data Compression
- Gambling and Data
Compression
- Kolmogorov
Complexity
- Channel
Capacity
- Differential
Entropy
- The
Gaussian channel
- Maximum
Entropy and Spectral Estimation
- Information
Theory and Statistics
- Rate
Distortion Theory
- Network
Information Theory
- Information
Theory and the Stock Market
- Inequalities
in Information Theory
