Reading Materials
Textbooks
- T. Berger. Rate Distortion Theory: A Mathematical Basis for Data
Compression. Prentice-Hall, 1971.
- D. P. Bertsekas, R. G. Gallager. Data Networks (2nd
edition). Prentice-Hall, 1991.
- J. H. Conway, N. J. A. Sloane. Sphere Packings, Lattices and
Groups (3rd edition). Springer-Verlag, 1998.
- T. H. Cormen, C. E. Leiserson, R. L. Rivest. Introduction to
Algorithms. MIT Press, 1990.
- T. M. Cover, J. A. Thomas. Elements of Information Theory.
Wiley, 1991.
- P. R. Kumar, P. Varaiya. Stochastic Systems: Estimation,
Identification, and Adaptive Control. Prentice-Hall, 1986.
- S. P. Meyn, R. L. Tweedie. Markov Chains and Stochastic
Stability. Springer-Verlag, 1993.
Papers on Networks
Of a survey nature
- A. Ephremides, B. Hajek. Information Theory and Communication
Networks: An Unconsumated Union. IEEE Transactions on Information
Theory, 44(6):2416-2434, 1998.
On codes and networks
- R. G. Gallager. Basic Limits on Protocol Information in Data
Communication Networks. IEEE Transactions on Information Theory,
22(4):385-398, 1976.
- R. G. Gallager. Finding Parity in a Simple Broadcast Network.
IEEE Transactions on Information Theory, 34(2):176-180, 1988.
- David Tse. Variable-rate Lossy Compression and its Effects on
Communication Networks. PhD Thesis, Massachusetts Institute of
Technology, September 1994.
- Tornado codes, 1997-2001.
- Q. M. Malluhi, W. E. Johnston. Coding for High Availability of a
Distributed-Parallel Storage System. IEEE Transactions on Parallel
and Distributed Systems, 9(12):1237-1252, 1998.
- R. Ahlswede, N. Cai, S.-Y. R. Li, R. W. Yeung. Network Information
Flow. IEEE Transactions on Information Theory, 46(4):1204-1216,
2000.
On routing and delay models
- I. Rubin. Data Compression for Communication Networks: The
Delay-Distortion Function. IEEE Transactions on Information Theory,
22(6):655-665, 1976.
- Chapters 3 and 5, textbook of Bertsekas and Gallager.
- V. Anantharam, S. Verdú. Bits Through Queues. IEEE
Transactions on Information Theory, 42(1):4-18, 1996.
- Limit behavior of controlled queues.
On small-world graphs
- D. J. Watts. Small Worlds: The Dynamics of Networks between
Order and Randomness. Princeton University Press, 1999.
- J. Kleinberg. The Small-World Phenomenon: An Algorithmic
Perspective. Cornell Computer Science Technical Report 99-1776,
October 1999.
On wireless networks
- P. Gupta, P. R. Kumar. The Capacity of Wireless Networks.
IEEE Transactions on Information Theory, 46(2):388-404, 2000.
- M. Grossglauser, D. Tse. Mobility Increases the Capacity of
Ad-Hoc Wireless Networks. IEEE Infocom 2001.
- S. Toumpis, A. J. Goldsmith. Capacity Regions for Wireless Ad Hoc
Networks. Submitted for publication.
On multiaccess protocols
- Chapter 4, textbook of Bersekas and Gallager.
Papers on Multiuser Information Theory
Of a survey nature
- A. D. Wyner. Recent Results in Shannon Theory. IEEE
Transactions on Information Theory, IT-20(1):2-10, 1974.
- E. C. van der Meulen. A Survey of Multi-Way Channels in
Information Theory: 1961-1976. IEEE Transactions on Information
Theory, IT-23(1):1-17, 1977.
- Chapter 14, textbook of Cover and Thomas.
On broadcast channels
- T. M. Cover. Broadcast Channels. IEEE Transactions on
Information Theory, IT-18(1):2-14, 1972.
- P. Bergmans. Random Coding Theorem for Broadcast Channels with
Degraded Components. IEEE Transactions on Information Theory,
IT-19(2):197-207, 1973.
- R. G. Gallager. Capacity and Coding for Degraded Broadcast
Channels. Problemy Peredachi Informatsii, 10(3):3-14, 1974.
- P. P. Bergmans, T. M. Cover. Cooperative Broadcasting. IEEE
Transactions on Information Theory, 20(3):317-325, 1974.
- W. H. R. Equitz, T. M. Cover. Successive Refinement of
Information. IEEE Transactions on Information Theory,
37(2):269-275, 1991.
On multiple access channels
- Chapter 14, Section 3, textbook of Cover and Thomas.
On multiple descriptions
- L. H. Ozarow. On a Source-Coding Problem with Two Channels and
Three Receivers. Bell System Technical Journal, 59(10):1909-1921,
1980.
- A. A. El Gamal, T. M. Cover. Achievable Rates for Multiple
Descriptions. IEEE Transactions on Information Theory,
28(6):851-857, November 1982.
- R. Ahlswede. The Rate/Distortion Region for Multiple Descriptions
without Excess Rate. IEEE Transactions on Information Theory,
IT-31(6):721-726, 1985.
- Z. Zhang, T. Berger. Multiple Description Source Coding with No
Excess Marginal Rate. IEEE Transactions on Information Theory,
41(2):349-357, 1995.
- V. A. Vaishampayan, N. J. A. Sloane, S. D. Servetto. Multiple
Description Vector Quantization with Lattice Codebooks: Design and
Analysis. IEEE Transactions on Information Theory, 47(5):1718-1734,
2001.
On coding of distributed correlated sources
- D. Slepian, J. K. Wolf. Noiseless Coding of Correlated Information
Sources. IEEE Transactions on Information Theory, IT-19(4):471-480,
1973. An alternative proof of the same result: T. M. Cover, A
Proof of the Data Compression Theorem of Slepian and Wolf for Ergodic
Sources, same transactions, IT-21(2):226-228, 1975.
- A. D. Wyner, J. Ziv. The Rate-Distortion Function for Source
Coding with Side Information at the Decoder. IEEE Transactions
on Information Theory, IT-22(1):1-10, 1976.
- A. H. Kaspi, T. Berger. Rate-Distortion for Correlated Sources with
Partially Separated Encoders. IEEE Transactions on Information
Theory, IT-28(6):828-840, 1982.
- R. Zamir. The Rate Loss in the Wyner-Ziv Problem. IEEE
Transactions on Information Theory, 42(6):2073-2084, 1996.
- Recent work on the design of quantizers.
Other Useful Papers
On channel capacity:
- R. E. Blahut. Computation of Channel Capacity and Rate-Distortion
Functions. IEEE Transactions on Information Theory,
IT-18(4):460-473, 1972.
On quantization theory:
- A. Gersho. Asymptotically Optimal Block Quantization. IEEE
Transactions on Information Theory, IT-25(4):373-380, 1979.