Algebraic theory of optimal filterbanks

We introduce an optimality theory for finite impulse response (FIR) filterbanks using a general algebraic point of view. We consider an admissible set /spl Lscr/ of FIR filterbanks and use scalability as the main notion based on which performance of the elements in /spl Lscr/are compared. We show that quantification of scalability leads naturally to a partial ordering on the set /spl Lscr/. An optimal solution is, therefore, represented by the greatest element in /spl Lscr/. It turns out that a greatest element does not necessarily exist in /spl Lscr/. Hence, one has to settle with one of the maximal elements that exist in /spl Lscr/. We provide a systematic way of finding a maximal element by embedding the partial ordering at hand in a total ordering. This is done by using a special class of order-preserving functions known as Schur-convex. There is, however, a price to pay for achieving a total ordering: there are infinitely many possible choices for Schur-convex functions, and the optimal solution specified in /spl Lscr/ depends on this (subjective) choice. An interesting aspect of the presented algebraic theory is that the connection between several concepts, namely, principal component filterbanks (PCFBs), filterbanks with maximum coding gain, and filterbanks with good scalability, is clearly revealed. We show that these are simply associated with different extremal elements of the partial ordering induced on /spl Lscr/ by scalability.

[1]  S. Biyiksiz,et al.  Multirate digital signal processing , 1985, Proceedings of the IEEE.

[2]  P. P. Vaidyanathan,et al.  Theory of optimal orthonormal subband coders , 1998, IEEE Trans. Signal Process..

[3]  Toby Berger,et al.  Lossy Source Coding , 1998, IEEE Trans. Inf. Theory.

[4]  I. Vajda Theory of statistical inference and information , 1989 .

[5]  Michael Unser Extension of the Karhunen-Loeve transform for wavelets and perfect reconstruction filterbanks , 1993, Optics & Photonics.

[6]  Mihai Anitescu,et al.  Theory of rate-distortion-optimal, constrained filterbanks-application to IIR and FIR biorthogonal designs , 2000, IEEE Trans. Signal Process..

[7]  Bruce A. Francis,et al.  An information theoretic method for designing multiresolution principal component transforms , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[8]  F. J. Budden,et al.  An introduction to algebraic structures , 1976 .

[9]  David Bull,et al.  Insights into mobile multimedia communications , 1998 .

[10]  Nick Kingsbury,et al.  Error resilient image and video coding for wireless communication systems , 1999 .

[11]  Stephen A. Dyer,et al.  Digital signal processing , 2018, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[13]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[14]  Alfred Mertins,et al.  Signal Analysis: Wavelets, Filter Banks, Time-Frequency Transforms and Applications , 1999 .

[15]  Multirate spectral estimation , 2001, 2001 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (IEEE Cat. No.01CH37233).

[16]  Claude E. Shannon,et al.  A Note on a Partial Ordering for Communication Channels , 1958, Information and Control.

[17]  P. P. Vaidyanathan,et al.  Filterbank optimization with convex objectives and the optimality of principal component forms , 2001, IEEE Trans. Signal Process..

[18]  R.N. Bracewell,et al.  Signal analysis , 1978, Proceedings of the IEEE.

[19]  Phillip A. Regalia,et al.  Attainable error bounds in multirate adaptive lossless FIR filters , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[20]  Pierre Moulin,et al.  Theory and design of signal-adapted FIR paraunitary filter banks , 1998, IEEE Trans. Signal Process..

[21]  Bruce A. Francis,et al.  Algebraic theory of optimal filter banks , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[22]  Georgios B. Giannakis,et al.  Principal component filter banks for optimal multiresolution analysis , 1995, IEEE Trans. Signal Process..

[23]  Tunc Geveci,et al.  Advanced Calculus , 2014, Nature.

[24]  P. Dewilde,et al.  Time-Varying Systems and Computations , 1998 .

[25]  Clifford T. Mullis,et al.  Minimum mean-squared error transform coding and subband coding , 1996, IEEE Trans. Inf. Theory.

[26]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..

[27]  Toby Berger,et al.  Review of Information Theory: Coding Theorems for Discrete Memoryless Systems (Csiszár, I., and Körner, J.; 1981) , 1984, IEEE Trans. Inf. Theory.

[28]  R. Tennant Algebra , 1941, Nature.

[29]  Sergio Verdu,et al.  Information theory: 50 years of discovery , 2000 .

[30]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[31]  P. P. Vaidyanathan,et al.  On existence of FIR principal component filter banks , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[32]  Roberto H. Bamberger,et al.  FIR principal component filter banks , 1998, IEEE Trans. Signal Process..

[33]  S. Mallat A wavelet tour of signal processing , 1998 .

[34]  Karlheinz Brandenbrg,et al.  First Ideas on Scalable Audio Coding , 1994 .

[35]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[36]  P. P. Vaidyanathan,et al.  Coding gain in paraunitary analysis/synthesis systems , 1993, IEEE Trans. Signal Process..

[37]  David Bull,et al.  Scalable image and video coding algorithms , 1998 .

[38]  P. P. Vaidyanathan,et al.  Theory and design of optimum FIR compaction filters , 1998, IEEE Trans. Signal Process..

[39]  P. Graefe Linear stochastic systems , 1966 .

[40]  Benoit M. Macq,et al.  Signal-adapted multiresolution transform for image coding , 1992, IEEE Trans. Inf. Theory.

[41]  Stéphane Mallat,et al.  Analysis of low bit rate image transform coding , 1998, IEEE Trans. Signal Process..

[42]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.