A Review of the Theory and Applications of Optimal Subband and Transform Coders

Abstract The problem of optimizing digital filter banks based on input statistics was perhaps first addressed nearly four decades ago by Huang and Schultheiss. These authors actually considered a special case, namely transform coder optimization. Many of the subband coder optimization problems considered in recent years have close similarities to this work, though there are fundamental differences as well. Filter banks are used today not only for signal compression, but have found applications in signal denoising and in digital communications. A recent result is that principal component filter banks (PCFBs) offer an optimal solution to many problems under certain theoretical assumptions. While this result is quite powerful and includes several earlier results as special cases, there still remain some open problems in the area of filter bank optimization. We first give a review of the older classical methods to place the ideas in the right perspective. We then review recent results on PCFBs. The generality of these results is demonstrated by showing an application in digital communications (the discrete multitone channel). We show, for example, that the PCFB minimizes transmitted power for a given probability of error and bit rate. Future directions and open problems are discussed as well.

[1]  Martin Vetterli,et al.  Perfect transmultiplexers , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  P. P. Vaidyanathan,et al.  Optimum low cost two channel IIR orthonormal filter bank , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  P. P. Vaidyanathan,et al.  Some results in the theory of crosstalk-free transmultiplexers , 1991, IEEE Trans. Signal Process..

[4]  Henrique S. Malvar,et al.  Signal processing with lapped transforms , 1992 .

[5]  J.A.C. Bingham,et al.  Multicarrier modulation for data transmission: an idea whose time has come , 1990, IEEE Communications Magazine.

[6]  Jamal Tuqan,et al.  A state space approach to the design of globally optimal FIR energy compaction filters , 2000, IEEE Trans. Signal Process..

[7]  P. P. Vaidyanathan,et al.  Orthonormal and biorthonormal filter banks as convolvers, and convolutional coding gain , 1993, IEEE Trans. Signal Process..

[8]  P. P. Vaidyanathan,et al.  Statistically optimal synthesis banks for subband coders , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[9]  Henrique S. Malvar,et al.  On the asymptotic performance of hierarchical transforms , 1992, IEEE Trans. Signal Process..

[10]  Are Hjørungnes,et al.  Minimum mean square error FIR filter banks with arbitrary filter lengths , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[11]  Arun N. Netravali,et al.  Digital Pictures: Representation, Compression and Standards , 1995 .

[12]  Henrique S. Malvar,et al.  The LOT: transform coding without blocking effects , 1989, IEEE Trans. Acoust. Speech Signal Process..

[13]  Michael Unser,et al.  On the optimality of ideal filters for pyramid and wavelet signal approximation , 1993, IEEE Trans. Signal Process..

[14]  P. P. Vaidyanathan,et al.  Theory of optimal orthonormal subband coders , 1998, IEEE Trans. Signal Process..

[15]  P. P. Vaidyanathan,et al.  On existence of FIR principal component filter banks , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[16]  P. P. Vaidyanathan,et al.  Theory and design of optimum FIR compaction filters , 1998, IEEE Trans. Signal Process..

[17]  John M. Cioffi,et al.  A Discrete Multitone Transceiver System for HDSL Applications , 1991, IEEE J. Sel. Areas Commun..

[18]  Irving Kalet,et al.  The multitone channel , 1989, IEEE Trans. Commun..

[19]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[20]  C. Burrus,et al.  Optimal wavelet representation of signals and the wavelet sampling theorem , 1994 .

[21]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[22]  Ali N. Akansu,et al.  Orthogonal transmultiplexers in communication: a review , 1998, IEEE Trans. Signal Process..

[23]  Pierre Moulin.  A new look at signal-adapted QMF bank design , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[24]  P. P. Vaidyanathan,et al.  Filterbank optimization with convex objectives and the optimality of principal component forms , 2001, IEEE Trans. Signal Process..

[25]  P. P. Vaidyanathan,et al.  Nonuniform principal component filter banks: definitions, existence, and optimality , 2000, SPIE Optics + Photonics.

[26]  Joel Franklin,et al.  Methods of Mathematical Economics , 1980 .

[27]  Necdet Uzun,et al.  Modeling, analysis, and compensation of quantization effects in M-band subband codecs , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[28]  Brian D. O. Anderson,et al.  Optimum subband coding of cyclostationary signals , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[29]  P. P. Vaidyanathan,et al.  OPTIMALITY OF ORTHONORMAL TRANSFORMS FOR SUBBAND CODING , 1998 .

[30]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[31]  A. Spanias,et al.  Perceptual coding of digital audio , 2000, Proceedings of the IEEE.

[32]  William A. Pearlman,et al.  On entropy of pyramid structures , 1991, IEEE Trans. Inf. Theory.

[33]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[34]  Michael G. Strintzis,et al.  Optimal pyramidal and subband decompositions for hierarchical coding of noisy and quantized images , 1998, IEEE Trans. Image Process..

[35]  Roberto H. Bamberger,et al.  FIR principal component filter banks , 1998, IEEE Trans. Signal Process..

[36]  Adrian Segall.  Bit allocation and encoding for vector sources , 1976, IEEE Trans. Inf. Theory.

[37]  P. P. Vaidyanathan,et al.  On optimization of filter banks with denoising applications , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[38]  John M. Cioffi,et al.  Filter bank modulation techniques for very high speed digital subscriber lines , 2000 .

[39]  Clifford T. Mullis,et al.  Minimum mean-squared error transform coding and subband coding , 1996, IEEE Trans. Inf. Theory.

[40]  Pierre Moulin,et al.  Theory and design of signal-adapted FIR paraunitary filter banks , 1998, IEEE Trans. Signal Process..

[41]  Georgios B. Giannakis,et al.  Principal component filter banks for optimal multiresolution analysis , 1995, IEEE Trans. Signal Process..

[42]  Ali N. Akansu,et al.  A distortion analysis and optimal design of orthogonal basis for DMT transceivers , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[43]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[44]  P. P. Vaidyanathan,et al.  Optimality of principal component filter banks for discrete multitone communication systems , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[45]  Thomas R. Fischer.  On the rate-distortion efficiency of subband coding , 1992, IEEE Trans. Inf. Theory.

[46]  J.-J. Werner,et al.  The HDSL environment (high bit rate digital subscriber line) , 1991 .

[47]  P. P. Vaidyanathan,et al.  Results on optimal biorthogonal filter banks , 1998 .

[48]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[49]  See-May Phoong,et al.  Optimal DMT transceivers over fading channels , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[50]  John G. Proakis,et al.  Comparison of DFT and cosine modulated filter banks in multicarrier modulation , 1994, 1994 IEEE GLOBECOM. Communications: The Global Bridge.

[51]  Mihai Anitescu,et al.  Theory of rate-distortion-optimal, constrained filterbanks-application to IIR and FIR biorthogonal designs , 2000, IEEE Trans. Signal Process..

[52]  P. P. Vaidyanathan,et al.  Considerations in the design of optimum compaction filters for subband coders , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[53]  Jean-Jacques Werner,et al.  The HDSL Environment , 1991, IEEE J. Sel. Areas Commun..

[54]  P. P. Vaidyanathan,et al.  On optimal analysis/synthesis filters for coding gain maximization , 1996, IEEE Trans. Signal Process..

[55]  Hideaki Sakai,et al.  Optimization of filter banks using cyclostationary spectral analysis , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[56]  P. P. Vaidyanathan,et al.  Results on principal component filter banks: Colored noise suppression and existence issues , 2001, IEEE Trans. Inf. Theory.

[57]  Peter N. Heller,et al.  DMT systems, DWMT systems and digital filter banks , 1994, Proceedings of ICC/SUPERCOMM'94 - 1994 International Conference on Communications.

[58]  Tor A. Ramstad,et al.  On the optimality of nonunitary filter banks in subband coders , 1995, IEEE Transactions on Image Processing.

[59]  P. Schultheiss,et al.  Block Quantization of Correlated Gaussian Random Variables , 1963 .

[60]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[61]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[62]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[63]  Deepen Sinha,et al.  On the optimal choice of a wavelet for signal representation , 1992, IEEE Trans. Inf. Theory.

[64]  Ali N. Akansu,et al.  On-signal decomposition techniques , 1991 .

[65]  Are Hjørungnes,et al.  Jointly optimal analysis and synthesis filter banks for bit constrained source coding , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[66]  Robert Bregovic,et al.  Multirate Systems and Filter Banks , 2002 .

[67]  R. Haddad,et al.  Multiresolution Signal Decomposition: Transforms, Subbands, and Wavelets , 1992 .

[68]  Mark J. T. Smith,et al.  Subband and Wavelet Transforms , 1996 .

[69]  K. H. Barratt.  Digital Coding of Waveforms , 1985 .

[70]  P. P. Vaidyanathan,et al.  Role of principal component filter banks in noise reduction , 1999, Optics & Photonics.

[71]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[72]  P. P. Vaidyanathan.  Review of recent results on optimal orthonormal subband coders , 1997, Optics & Photonics.

[73]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[74]  B. P. Lathi,et al.  Modern Digital and Analog Communication Systems , 1983 .