论文信息 - Fundamental limits of almost lossless analog compression

Fundamental limits of almost lossless analog compression

In Shannon theory, lossless source coding deals with the optimal compression of discrete sources. Compressed sensing is a lossless coding strategy for analog sources by means of multiplication by real-valued matrices. In this paper we study almost lossless analog compression for analog memoryless sources in an information-theoretic framework, in which the compressor is not constrained to linear transformations but it satisfies various regularity conditions such as Lipschitz continuity. The fundamental limit is shown to be the information dimension proposed by Rényi in 1959.

Sergio Verdú | Yihong Wu | S. Verdú | Yihong Wu

[1] Sang Joon Kim,et al. A Mathematical Theory of Communication , 2006 .

[2] A. Rényi. On the dimension and entropy of probability distributions , 1959 .

[3] Emmanuel J. Candès,et al. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[4] Patrick Suppes,et al. Naive Set Theory , 1961 .

[5] E. Candès,et al. Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[6] Martin J. Wainwright,et al. Information-theoretic limits on sparsity recovery in the high-dimensional and noisy setting , 2009, IEEE Trans. Inf. Theory.

[7] K. Falconer. Techniques in fractal geometry , 1997 .

[8] Stefan Friedrich,et al. Topology , 2019, Arch. Formal Proofs.

[9] Kenneth Falconer,et al. GEOMETRY OF SETS AND MEASURES IN EUCLIDEAN SPACES FRACTALS AND RECTIFIABILITY , 1996 .

[10] Andrea Montanari,et al. Smooth compression, Gallager bound and nonlinear sparse-graph codes , 2008, 2008 IEEE International Symposium on Information Theory.

[11] David L Donoho,et al. Compressed sensing , 2006, IEEE Transactions on Information Theory.

[12] Yihong Wu,et al. Rényi Information Dimension: Fundamental Limits of Almost Lossless Analog Compression , 2010, IEEE Transactions on Information Theory.

[13] Amir Dembo,et al. The rate-distortion dimension of sets and measures , 1994, IEEE Trans. Inf. Theory.