Introduction to Data Compression

Preface 1 Introduction 1.1 Compression Techniques 1.1.1 Lossless Compression 1.1.2 Lossy Compression 1.1.3 Measures of Performance 1.2 Modeling and Coding 1.3 Organization of This Book 1.4 Summary 1.5 Projects and Problems 2 Mathematical Preliminaries 2.1 Overview 2.2 A Brief Introduction to Information Theory 2.3 Models 2.3.1 Physical Models 2.3.2 Probability Models 2.3.3. Markov Models 2.3.4 Summary 2.5 Projects and Problems 3 Huffman Coding 3.1 Overview 3.2 "Good" Codes 3.3. The Huffman Coding Algorithm 3.3.1 Minimum Variance Huffman Codes 3.3.2 Length of Huffman Codes 3.3.3 Extended Huffman Codes 3.4 Nonbinary Huffman Codes 3.5 Adaptive Huffman Coding 3.5.1 Update Procedure 3.5.2 Encoding Procedure 3.5.3 Decoding Procedure 3.6 Applications of Huffman Coding 3.6.1 Lossless Image Compression 3.6.2 Text Compression 3.6.3 Audio Compression 3.7 Summary 3.8 Projects and Problems 4 Arithmetic Coding 4.1 Overview 4.2 Introduction 4.3 Coding a Sequence 4.3.1 Generating a Tag 4.3.2 Deciphering the Tag 4.4 Generating a Binary Code 4.4.1 Uniqueness and Efficiency of the Arithmetic Code 4.4.2 Algorithm Implementation 4.4.3 Integer Implementation 4.5 Comparison of Huffman and Arithmetic Coding 4.6 Applications 4.6.1 Bi-Level Image Compression-The JBIG Standard 4.6.2 Image Compression 4.7 Summary 4.8 Projects and Problems 5 Dictionary Techniques 5.1 Overview 5.2 Introduction 5.3 Static Dictionary 5.3.1 Diagram Coding 5.4 Adaptive Dictionary 5.4.1 The LZ77 Approach 5.4.2 The LZ78 Approach 5.5 Applications 5.5.1 File Compression-UNIX COMPRESS 5.5.2 Image Compression-the Graphics Interchange Format (GIF) 5.5.3 Compression over Modems-V.42 bis 5.6 Summary 5.7 Projects and Problems 6 Lossless Image Compression 6.1 Overview 6.2 Introduction 6.3 Facsimile Encoding 6.3.1 Run-Length Coding 6.3.2 CCITT Group 3 and 4-Recommendations T.4 and T.6 6.3.3 Comparison of MH, MR, MMR, and JBIG 6.4 Progressive Image Transmission 6.5 Other Image Compression Approaches 6.5.1 Linear Prediction Models 6.5.2 Context Models 6.5.3 Multiresolution Models 6.5.4 Modeling Prediction Errors 6.6 Summary 6.7 Projects and Problems 7 Mathematical Preliminaries 7.1 Overview 7.2 Introduction 7.3 Distortion Criteria 7.3.1 The Human Visual System 7.3.2 Auditory Perception 7.4 Information Theory Revisted 7.4.1 Conditional Entropy 7.4.2 Average Mutual Information 7.4.3 Differential Entropy 7.5 Rate Distortion Theory 7.6 Models 7.6.1 Probability Models 7.6.2 Linear System Models 7.6.3 Physical Models 7.7 Summary 7.8 Projects and Problems 8 Scalar Quantization 8.1 Overview 8.2 Introduction 8.3 The Quantization Problem 8.4 Uniform Quantizer 8.5 Adaptive Quantization 8.5.1 Forward Adaptive Quantization 8.5.2 Backward Adaptive Quantization 8.6 Nonuniform Quantization 8.6.1 pdf-Optimized Quantization 8.6.2 Companded Quantization 8.7 Entropy-Coded Quantization 8.7.1 Entropy Coding of Lloyd-Max Quantizer Outputs 8.7.2 Entropy-Constrained Quantization 8.7.3 High-Rate Optimum Quantization 8.8 Summary 8.9 Projects and Problems 9 Vector Quantization 9.1 Overview 9.2 Introduction 9.3 Advantages of Vector Quantization over Scalar Quantization 9.4 The Linde-Buzo-Gray Algorithm 9.4.1 Initializing the LBG Algorithm 9.4.2 The Empty Cell Problem 9.4.3 Use of LBG for Image Compression 9.5 Tree-Structured Vector Quantizers 9.5.1 Design of Tree-Structured Vector Quantizers 9.6 Structured Vector Quantizers 9.6.1 Pyramid Vector Quantization 9.6.2 Polar and Spherical Vector Quantizers 9.6.3 Lattice Vector Quantizers 9.7 Variations on the Theme 9.7.1 Gain-Shape Vector Quantization 9.7.2 Mean-Removed Vector Quantization 9.7.3 Classified Vector Quantization 9.7.4 Multistage Vector Quantization 9.7.5 Adaptive Vector Quantization 9.8 Summary 9.9 Projects and Problems 10 Differential Encoding 10.1 Overview 10.2 Introduction 10.3 The Basic Algorithm 10.4 Prediction in DPCM 10.5 Adaptive DPCM (ADPCM) 10.5.1 Adaptive Quantization in DPCM 10.5.2 Adaptive Prediction in DPCM 10.6 Delta Modulation 10.6.1 Constant Factor Adaptive Delta Modulation (CFDM) 10.6.2 Continuously Variable Slope Delta Modulation 10.7 Speech Coding 10.7.1 G.726 10.8 Summary 10.9 Projects and Problems 11 Subband Coding 11.1 Overview 11.2 Introduction 11.3 The Frequency Domain and Filtering 11.3.1 Filters 11.4 The Basic Subband Coding Algorithm 11.4.1 Bit Allocation 11.5 Application to Speech Coding-G.722 11.6 Application to Audio Coding-MPEG Audio 11.7 Application to Image Compression 11.7.1 Decomposing an Image 11.7.2 Coding the Subbands 11.8 Wavelets 11.8.1 Families of Wavelets 11.8.2 Wavelets and Image Compression 11.9 Summary 11.10 Projects and Problems 12 Transform Coding 12.1 Overview 12.2 Introduction 12.3 The Transform 12.4 Transforms of Interest 12.4.1 Karhunen-Loeve Transform 12.4.2 Discrete Cosine Transform 12.4.3 Discrete Sine Transform 12.4.4 Discrete Walsh-Hadamard Transform 12.5 Quantization and Coding of Transform Coefficients 12.6 Application to Image Compression-JPEG 12.6.1 The Transform 12.6.2 Quantization 12.6.3 Coding 12.7 Application to Audio Compression 12.8 Summary 12.9 Projects and Problems 13 Analysis/Synthesis Schemes 13.1 Overview 13.2 Introduction 13.3 Speech Compression 13.3.1 The Channel Vocoder 13.3.2 The Linear Predictive Coder (Gov.Std.LPC-10) 13.3.3 Code Excited Linear Prediction (CELP) 13.3.4 Sinusoidal Coders 13.4 Image Compression 13.4.1 Fractal Compression 13.5 Summary 13.6 Projects and Problems 14 Video Compression 14.1 Overview 14.2 Introduction 14.3 Motion Compensation 14.4 Video Signal Representation 14.5 Algorithms for Videoconferencing and Videophones 14.5.1 ITU_T Recommendation H.261 14.5.2 Model-Based Coding 14.6 Asymmetric Applications 14.6.1 The MPEG Video Standard 14.7 Packet Video 14.7.1 ATM Networks 14.7.2 Compression Issues in ATM Networks 14.7.3 Compression Algorithms for Packet Video 14.8 Summary 14.9 Projects and Problems A Probability and Random Processes A.1 Probability A.2 Random Variables A.3 Distribution Functions A.4 Expectation A.5 Types of Distribution A.6 Stochastic Process A.7 Projects and Problems B A Brief Review of Matrix Concepts B.1 A Matrix B.2 Matrix Operations C Codes for Facsimile Encoding D The Root Lattices Bibliography Index

[1]  Robert F. Rice,et al.  On the optimality of code options for a universal noiseless coder , 1991 .

[2]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[3]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[4]  Marina Bosi,et al.  High-Quality, Low-Rate Audio Transform Coding for Transmission and Multimedia Applications , 1992 .

[5]  Nasser M. Nasrabadi,et al.  Image coding using vector quantization: a review , 1988, IEEE Trans. Commun..

[6]  Mark Nelson,et al.  The Data Compression Book , 2009 .

[7]  H. Dudley,et al.  The Speaking Machine of Wolfgang von Kempelen , 1949 .

[8]  Henrique S. Malvar,et al.  Signal processing with lapped transforms , 1992 .

[9]  Suguru Arimoto,et al.  An algorithm for computing the capacity of arbitrary discrete memoryless channels , 1972, IEEE Trans. Inf. Theory.

[10]  Bishnu S. Atal,et al.  A new model of LPC excitation for producing natural-sounding speech at low bit rates , 1982, ICASSP.

[11]  P. Vaidyanathan Multirate Systems And Filter Banks , 1992 .

[12]  Peter F. Swaszek,et al.  Multidimensional spherical coordinates quantization , 1983, IEEE Trans. Inf. Theory.

[13]  R. Gray,et al.  Speech coding based upon vector quantization , 1980, ICASSP.

[14]  S. A. Martucci,et al.  Reversible compression of HDTV images using median adaptive prediction and arithmetic coding , 1990, IEEE International Symposium on Circuits and Systems.

[15]  Robert J. McEliece,et al.  The Theory of Information and Coding , 1979 .

[16]  Glen G. Langdon,et al.  A simple general binary source code , 1982, IEEE Trans. Inf. Theory.

[17]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[18]  M. Denn Optimization by variational methods , 1969 .

[19]  Glen G. Langdon,et al.  Arithmetic Coding , 1979 .

[20]  F. Campbell The human eye as an optical filter , 1968 .

[21]  John W. Woods,et al.  A filter based bit allocation scheme for subband compression of HDTV , 1992, IEEE Trans. Image Process..

[22]  Thomas R. Fischer,et al.  A pyramid vector quantizer , 1986, IEEE Trans. Inf. Theory.

[23]  Jerry D. Gibson,et al.  Sequentially Adaptive Prediction and Coding of Speech Signals , 1974, IEEE Trans. Commun..

[24]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[25]  Takehiro Moriya,et al.  High-quality audio-coding at less than 64 kbit/s by using transform-domain weighted interleave vector quantization (TwinVQ) , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[26]  Wolfgang Mauersberger,et al.  Experimental results on the performance of mismatched quantizers , 1979, IEEE Trans. Inf. Theory.

[27]  K. H. Barratt Digital Coding of Waveforms , 1985 .

[28]  Nasir D. Memon,et al.  Recent Developments in Context-Based Predictive Techniques for Lossless Image Compression , 1997, Comput. J..

[29]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[30]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[31]  Haibo Li,et al.  Two-view facial movement estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[32]  Yen-Chun Lin,et al.  A Low-Delay CELP Coder for the CCITT 16 kb/s Speech Coding Standard , 1992, IEEE J. Sel. Areas Commun..

[33]  N. Jayant Adaptive quantization with a one-word memory , 1973 .

[34]  B. P. Lathi Signal Processing And Linear Systems , 1998 .

[35]  E. E. Hilbert Cluster compression algorithm: A joint clustering/data compression concept , 1977 .

[36]  Nasir D. Memon,et al.  Context-based, adaptive, lossless image coding , 1997, IEEE Trans. Commun..

[37]  Donald J. Newman,et al.  The hexagon theorem , 1982, IEEE Trans. Inf. Theory.

[38]  P. W. Jones,et al.  Digital Image Compression Techniques , 1991 .

[39]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[40]  T. Barnwell,et al.  A procedure for designing exact reconstruction filter banks for tree-structured subband coders , 1984, ICASSP.

[41]  Joseph P. Campbell,et al.  An expandable error-protected 4800 bps CELP coder (US Federal Standard 4800 bps voice coder) , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[42]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[43]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[44]  Jerry D. Gibson,et al.  On reflection coefficients and the Cholesky decomposition , 1977 .

[45]  Robert M. Gray,et al.  Pruned tree-structured vector quantization in image coding , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[46]  P. Wintz Transform picture coding , 1972 .

[47]  N. Ahmed,et al.  FAST TRANSFORMS, algorithms, analysis, applications , 1983, Proceedings of the IEEE.

[48]  Richard E. Blahut,et al.  Computation of channel capacity and rate-distortion functions , 1972, IEEE Trans. Inf. Theory.

[49]  R. Nigel Horspool,et al.  Data Compression Using Dynamic Markov Modelling , 1987, Comput. J..

[50]  Daniel W. Griffin,et al.  Multi-band excitation vocoder , 1987 .

[51]  A. Murat Tekalp,et al.  3-D motion estimation and wireframe adaptation including photometric effects for model-based coding of facial image sequences , 1994, IEEE Trans. Circuits Syst. Video Technol..

[52]  Debasis Mitra,et al.  Mathematical analysis of an adaptive quantizer , 1974 .

[53]  Allen Gersho,et al.  Speech and Audio Coding for Wireless and Network Applications , 1993 .

[54]  Barbara Hubbard,et al.  The World According to Wavelets , 1996 .

[55]  Dietmar Saupe,et al.  Optimal hierarchical partitions for fractal image compression , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[56]  Khalid Sayood,et al.  A robust coding scheme for packet video , 1992, IEEE Trans. Commun..

[57]  K. Sayood,et al.  Recursively indexed vector quantization of non-stationary sources , 1995, Proceedings DCC '95 Data Compression Conference.

[58]  Richard Clark Pasco,et al.  Source coding algorithms for fast data compression , 1976 .

[59]  L. Rabiner,et al.  The Application of dither to the quantization of speech signals , 1972 .

[60]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[61]  Kenzo Akagiri,et al.  ATRAC: Adaptive Transform Acoustic Coding for MiniDisc , 1992 .

[62]  Ronald W. Schafer,et al.  AudioPaK-an integer arithmetic lossless audio codec , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[63]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1997, Texts in Computer Science.

[64]  M. G. Pelchat,et al.  Compression of Black-White Images with Arithmetic Coding , 1981 .

[65]  Stephen G. Wilson,et al.  Magnitude/Phase Quantization of Independent Gaussian Variates , 1980, IEEE Trans. Commun..

[66]  Martin Vetterli,et al.  Multirate Filter Banks for Subband Coding , 1991 .

[67]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[68]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.

[69]  V. Cuperman,et al.  Vector quantization: A pattern-matching technique for speech coding , 1983, IEEE Communications Magazine.

[70]  B. Prasada,et al.  Image Sequence Coding , 1981 .

[71]  James Durbin,et al.  The fitting of time series models , 1960 .

[72]  Peter Elias,et al.  Universal codeword sets and representations of the integers , 1975, IEEE Trans. Inf. Theory.

[73]  Manfred R. Schroeder,et al.  Linear predictive coding of speech: Review and current directions , 1985, IEEE Communications Magazine.

[74]  Y. Yasuda,et al.  Overview of digital facsimile coding techniques in Japan , 1980, Proceedings of the IEEE.

[75]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[76]  Robert F. Rice,et al.  Some practical universal noiseless coding techniques , 1979 .

[77]  Richard W. Hamming,et al.  Coding and Information Theory , 1980 .

[78]  Glen G. Langdon,et al.  An Introduction to Arithmetic Coding , 1984, IBM J. Res. Dev..

[79]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[80]  Claude E. Shannon,et al.  Prediction and Entropy of Printed English , 1951 .

[81]  Christopher F. Barnes,et al.  Residual vector quantizers with jointly optimized code books , 1992 .

[82]  Anil K. Jain,et al.  Recursive Block Coding - A New Approach to Transform Coding , 1986, IEEE Transactions on Communications.

[83]  Frederick Jelinek,et al.  Probabilistic Information Theory: Discrete and Memoryless Models , 1968 .

[84]  W. R. Bennett,et al.  Spectra of quantized signals , 1948, Bell Syst. Tech. J..

[85]  William K. Pratt,et al.  Scene Adaptive Coder , 1984, IEEE Trans. Commun..

[86]  I-Chen Wu A Context-based, Adaptive, Lossless/nearly-lossless Coding Scheme for Continuous-tone Images , 1995 .

[87]  Jorma Rissanen,et al.  A multiplication-free multialphabet arithmetic code , 1989, IEEE Trans. Commun..

[88]  Khalid Sayood,et al.  A hybrid LBG/lattice vector quantizer for high quality image coding , 1991 .

[89]  Allen Gersho,et al.  A training mode adaptive quantizer , 1974, IEEE Trans. Inf. Theory.

[90]  R. Crochiere,et al.  Quadrature mirror filter design in the time domain , 1984 .

[91]  Joan L. Mitchell,et al.  MPEG Video Compression Standard , 1996, Springer US.

[92]  Brian Parker Tunstall,et al.  Synthesis of noiseless compression codes , 1967 .

[93]  Khalid Sayood,et al.  Online compression of video sequences using adaptive VQ codebooks , 1994, Proceedings of IEEE Data Compression Conference (DCC'94).

[94]  Joseph P. Campbell,et al.  The Dod 4.8 Kbps Standard (Proposed Federal Standard 1016) , 1991 .

[95]  Toby Berger,et al.  Permutation codes for sources , 1972, IEEE Trans. Inf. Theory.

[96]  Henry Stark,et al.  Probability, Random Processes, and Estimation Theory for Engineers , 1995 .

[97]  Avideh Zakhor,et al.  Directionality and Scalability in Subband Image and Video Compression , 1996 .

[98]  Biing-Hwang Juang,et al.  Multiple stage vector quantization for speech coding , 1982, ICASSP.

[99]  Kiyoharu Aizawa,et al.  Model-based image coding advanced video coding techniques for very low bit-rate applications , 1995, Proc. IEEE.

[100]  Masud Mansuripur,et al.  Introduction to information theory , 1986 .

[101]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[102]  John Princen,et al.  Analysis/Synthesis filter bank design based on time domain aliasing cancellation , 1986, IEEE Trans. Acoust. Speech Signal Process..

[103]  Fred Mintzer,et al.  Filters for distortion-free two-band multirate filter banks , 1985, IEEE Trans. Acoust. Speech Signal Process..

[104]  Herbert Gish,et al.  Asymptotically efficient quantizing , 1968, IEEE Trans. Inf. Theory.

[105]  J. Gibson,et al.  Explicit additive noise models for uniform and nonuniform MMSE quantization , 1984 .

[106]  T. K. Truong,et al.  Comparison of international standards for lossless still image compression , 1994, Proc. IEEE.

[107]  H. Fletcher,et al.  Loudness, its definition, measurement and calculation. , 1933 .

[108]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[109]  Hakan Caglar,et al.  A generalized, parametric PR-QMF/wavelet transform design approach for multiresolution signal decomposition , 1991 .

[110]  K. Knowlton,et al.  Progressive transmission of grey-scale and binary pictures by simple, efficient, and lossless encoding schemes , 1980, Proceedings of the IEEE.

[111]  J.D. Gibson,et al.  Adaptive prediction in speech differential encoding systems , 1980, Proceedings of the IEEE.

[112]  P. Schultheiss,et al.  Block Quantization of Correlated Gaussian Random Variables , 1963 .

[113]  Jeffrey Scott Vitter,et al.  Design and analysis of dynamic Huffman codes , 1987, JACM.

[114]  J. Makhoul,et al.  Vector quantization in speech coding , 1985, Proceedings of the IEEE.

[115]  R. F. Rice,et al.  Algorithms for a very high speed universal noiseless coding module , 1991 .

[116]  Andrew J. Viterbi,et al.  Principles of Digital Communication and Coding , 1979 .

[117]  F. MacWilliams,et al.  The Theory of Error-Correcting Codes , 1977 .

[118]  A. Said,et al.  Manuscript Submitted to the Ieee Transactions on Circuits and Systems for Video Technology a New Fast and Eecient Image Codec Based on Set Partitioning in Hierarchical Trees , 2007 .

[119]  James D. Johnston,et al.  A filter family designed for use in quadrature mirror filter banks , 1980, ICASSP.

[120]  Takeshi Hirai,et al.  3 A necessary and sufficient condition , 1970 .

[121]  Alistair Moffat,et al.  Implementing the PPM data compression scheme , 1990, IEEE Trans. Commun..

[122]  N. J. A. Sloane,et al.  Voronoi regions of lattices, second moments of polytopes, and quantization , 1982, IEEE Trans. Inf. Theory.

[123]  Nuggehally Sampath Jayant,et al.  Adaptive delta modulation with a one-bit memory , 1970, Bell Syst. Tech. J..

[124]  Richard L. Frost,et al.  Vector quantizers with direct sum codebooks , 1993, IEEE Trans. Inf. Theory.

[125]  Karl Hellwig,et al.  Speech codec for the European mobile radio system , 1989, IEEE Global Telecommunications Conference, 1989, and Exhibition. 'Communications Technology for the 1990s and Beyond.

[126]  Ali Ghanim Al-Araj,et al.  Vector quantization of non-stationary sources , 1994 .

[127]  Ian H. Witten,et al.  Text Compression , 1990, 125 Problems in Text Algorithms.

[128]  Jack Capon,et al.  A probabilistic model for run-length coding of pictures , 1959, IRE Trans. Inf. Theory.

[129]  M.G. Bellanger,et al.  Digital processing of speech signals , 1980, Proceedings of the IEEE.

[130]  S. Golomb Run-length encodings. , 1966 .

[131]  Noam Chomsky,et al.  The Minimalist Program , 1992 .

[132]  Daniel S. Hirschberg,et al.  Data compression , 1987, CSUR.

[133]  Allen Gersho,et al.  Advances in speech and audio compression , 1994, Proc. IEEE.

[134]  Robert G. Gallager,et al.  Variations on a theme by Huffman , 1978, IEEE Trans. Inf. Theory.

[135]  Hanan Samet,et al.  The Design and Analysis of Spatial Data Structures , 1989 .

[136]  David J. Sakrison,et al.  A geometric treatment of the source encoding of a Gaussian random variable , 1968, IEEE Trans. Inf. Theory.

[137]  Ian H. Witten,et al.  Modeling for text compression , 1989, CSUR.

[138]  John R. Pierce,et al.  Symbols, Signals, and Noise: The Nature and Process of Communication. , 1961 .

[139]  Philip A. Chou,et al.  Optimal pruning with applications to tree-structured source coding and modeling , 1989, IEEE Trans. Inf. Theory.

[140]  D. J. Wheeler,et al.  A Block-sorting Lossless Data Compression Algorithm , 1994 .

[141]  Arnaud E. Jacquin,et al.  Image coding based on a fractal theory of iterated contractive image transformations , 1992, IEEE Trans. Image Process..

[142]  Khalid Sayood,et al.  Recursively indexed quantization of memoryless sources , 1992, IEEE Trans. Inf. Theory.

[143]  Ed F. Deprettere,et al.  Regular-pulse excitation-A novel approach to effective and efficient multipulse coding of speech , 1986, IEEE Trans. Acoust. Speech Signal Process..

[144]  R. Gallager Information Theory and Reliable Communication , 1968 .

[145]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[146]  David Salomon,et al.  Data Compression: The Complete Reference , 2006 .

[147]  K. R. Rao,et al.  Orthogonal Transforms for Digital Signal Processing , 1979, IEEE Transactions on Systems, Man and Cybernetics.

[148]  Joan L. Mitchell,et al.  Probability Estimation for the Q-Coder , 1988, IBM J. Res. Dev..

[149]  W. Adams,et al.  Quantizing Characteristics for Signals Having Laplacian Amplitude Probability Density Function , 1978, IEEE Trans. Commun..

[150]  Jorma Rissanen,et al.  Generalized Kraft Inequality and Arithmetic Coding , 1976, IBM J. Res. Dev..

[151]  Jerry D. Gibson,et al.  An algorithm for uniform vector quantizer design , 1984, IEEE Trans. Inf. Theory.

[152]  Gary L. Wise,et al.  On the existence of optimal quantizers , 1982, IEEE Trans. Inf. Theory.

[153]  Sethuraman Panchanathan,et al.  Adaptive algorithms for image coding using vector quantization , 1991, Signal Process. Image Commun..

[154]  Kari Karhunen,et al.  Über lineare Methoden in der Wahrscheinlichkeitsrechnung , 1947 .

[155]  J. A. Saghri,et al.  Terrain-adaptive transform coding of multispectral data , 1994, Proceedings of IGARSS '94 - 1994 IEEE International Geoscience and Remote Sensing Symposium.

[156]  Nariman Farvardin,et al.  Optimum quantizer performance for a class of non-Gaussian memoryless sources , 1984, IEEE Trans. Inf. Theory.

[157]  J. Kurths,et al.  On complexity measures , 1994 .

[158]  Davis Pan,et al.  A Tutorial on MPEG/Audio Compression , 1995, IEEE Multim..

[159]  Howard M. Dreizen,et al.  Content-Driven Progressive Transmission of Grey-Scale Images , 1987, IEEE Trans. Commun..

[160]  KENNETH R. SLOAN,et al.  Progressive Refinement of Raster Images , 1979, IEEE Transactions on Computers.

[161]  John G. Cleary,et al.  Unbounded Length Contexts for PPM , 1997 .

[162]  W. Pearlman,et al.  Polar Quantization of a Complex Gaussian Random Variable , 1979, IEEE Trans. Commun..

[163]  James A. Storer,et al.  Data Compression: Methods and Theory , 1987 .

[164]  S. S. Stevens,et al.  Hearing, Its Psychology And Physiology , 1983 .

[165]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[166]  Gunnar Karlsson,et al.  Packet video and its integration into the network architecture , 1989, IEEE J. Sel. Areas Commun..

[167]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[168]  N. J. A. Sloane,et al.  A fast encoding method for lattice codes and quantizers , 1983, IEEE Trans. Inf. Theory.

[169]  R. Hunter,et al.  International digital facsimile coding standards , 1980, Proceedings of the IEEE.

[170]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[171]  Glen G. Langdon,et al.  Universal modeling and coding , 1981, IEEE Trans. Inf. Theory.

[172]  J G Daugman,et al.  Information Theory and Coding , 2005 .

[173]  Kiyoharu Aizawa,et al.  Analysis and synthesis of facial image sequences in model-based image coding , 1994, IEEE Trans. Circuits Syst. Video Technol..

[174]  L. Chiariglione,et al.  The development of an integrated audiovisual coding standard: MPEG , 1995, Proc. IEEE.

[175]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[176]  R. Steele,et al.  Delta Modulation Systems , 1975 .

[177]  Ian H. Witten,et al.  Managing Gigabytes: Compressing and Indexing Documents and Images , 1999 .

[178]  James A. Bucklew,et al.  Some properties of uniform step size quantizers (Corresp.) , 1980, IEEE Trans. Inf. Theory.

[179]  D. Farden Solution of a toeplitz set of linear equations , 1976 .

[180]  Khalid Sayood,et al.  A progressive data compression scheme based upon adaptive transform coding: Mixture block coding of natural images , 1991 .

[181]  Bhaskar Ramamurthi,et al.  Classified Vector Quantization of Images , 1986, IEEE Trans. Commun..

[182]  Oscal T.-C. Chen,et al.  An adaptive high-speed lossy data compression , 1992, Data Compression Conference, 1992..

[183]  Robert L. Auger,et al.  The Space Shuttle Ground Terminal Delta Modulation System , 1978, IEEE Trans. Commun..

[184]  Steven L. Tanimoto,et al.  Image transmission with gross information first , 1979 .

[185]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[186]  Allen Gersho,et al.  Adaptive vector quantization by progressive codevector replacement , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[187]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[188]  Glen G. Langdon,et al.  An Overview of the Basic Principles of the Q-Coder Adaptive Binary Arithmetic Coder , 1988, IBM J. Res. Dev..

[189]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[190]  Joan L. Mitchell,et al.  Optimal Hardware and Software Arithmetic Coding Procedures for the Q-Coder , 1988, IBM J. Res. Dev..

[191]  R. Schafer,et al.  Two-dimensional linear prediction and its application to adaptive predictive coding of images , 1984 .

[192]  William Equitz,et al.  A new vector quantization clustering algorithm , 1989, IEEE Trans. Acoust. Speech Signal Process..

[193]  Max V. Mathews,et al.  A linear coding for transmitting a set of correlated signals , 1956, IRE Trans. Inf. Theory.

[194]  R. Gray,et al.  Product code vector quantizers for waveform and voice coding , 1984 .

[195]  Panos E. Papamichalis,et al.  Practical approaches to speech coding , 1987 .

[196]  N. J. A. Sloane,et al.  Fast quantizing and decoding and algorithms for lattice quantizers and codes , 1982, IEEE Trans. Inf. Theory.

[197]  Ian H. Witten,et al.  Data Compression Using Adaptive Coding and Partial String Matching , 1984, IEEE Trans. Commun..

[198]  Donald E. Knuth,et al.  Dynamic Huffman Coding , 1985, J. Algorithms.

[199]  L. Goddard Information Theory , 1962, Nature.

[200]  R. Gray Entropy and Information Theory , 1990, Springer New York.

[201]  Neil L. Gerr,et al.  Analysis of adaptive differential PCM of a stationary Gauss - Markov input , 1987, IEEE Trans. Inf. Theory.

[202]  Sadaoki Furui,et al.  Advances in Speech Signal Processing , 1991 .

[203]  Terry A. Welch,et al.  A Technique for High-Performance Data Compression , 1984, Computer.

[204]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[205]  A. Jacquin A fractal theory of iterated Markov operators with applications to digital image coding , 1989 .

[206]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[207]  James A. Storer,et al.  Data compression via textual substitution , 1982, JACM.

[208]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[209]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[210]  T. Bell,et al.  Better OPM/L Text Compression , 1986, IEEE Trans. Commun..

[211]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.