The role of linear semi-infinite programming in signal-adapted QMF bank design

We consider the problem of designing a perfect-reconstruction, FIR, quadrature-mirror filter (QMF) bank (H, G) adapted to input signal statistics, with the coding gain as the adaptation criterion. Maximization of the coding gain has so far been viewed as a difficult nonlinear constrained optimization problem. It is shown that the coding gain depends only on the product filter P(z)=H(z)H(z/sup -1/), and this transformation leads to a stable class of linear optimization problems having finitely many variables and infinitely many constraints, termed linear semi-infinite programming (SIP) problems. The sought-for, original filter H(z) is obtained by deflation and spectral factorization of P(z). With the SIP formulation, every locally optimal solution is also globally optimal and can be computed using reliable numerical algorithms. The natural regularity properties inherent in the SIP formulation enhance the performance of these algorithms. We present a comprehensive theoretical analysis of the SIP problem and its dual, characterize the optimal filters, and analyze uniqueness and sensitivity issues. All these properties are intimately related to those of the input signal and bring considerable insight into the nature of the adaptation process. We present discretization and cutting plane algorithms and apply both methods to several examples.

[1]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[2]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[3]  K. H. Barratt Digital Coding of Waveforms , 1985 .

[4]  Yipeng Liu,et al.  Statistically optimized PR-QMF design , 1991, Other Conferences.

[5]  Kenneth O. Kortanek,et al.  Semi-Infinite Programming and Applications , 1983, ISMP.

[6]  Mihai Anitescu,et al.  Design of signal-adapted FIR paraunitary filter banks , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[7]  P. P. Vaidyanathan,et al.  Lattice structures for optimal design and robust implementation of two-channel perfect-reconstruction QMF banks , 1988, IEEE Trans. Acoust. Speech Signal Process..

[8]  Michael Unser,et al.  On the optimality of ideal filters for pyramid and wavelet signal approximation , 1993, IEEE Trans. Signal Process..

[9]  Pierre Moulin A new look at signal-adapted QMF bank design , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[10]  M. Powell,et al.  Approximation theory and methods , 1984 .

[11]  Vladimir Pavlovic,et al.  Transform image coding based on joint adaptation of filter banks and tree structures , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[12]  Deepen Sinha,et al.  On the optimal choice of a wavelet for signal representation , 1992, IEEE Trans. Inf. Theory.

[13]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[14]  Avideh Zakhor,et al.  A multi-start algorithm for signal adaptive subband systems (image coding) , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Kenneth O. Kortanek,et al.  A Central Cutting Plane Algorithm for Convex Semi-Infinite Programming Problems , 1993, SIAM J. Optim..

[16]  Alexander Potchinkov,et al.  FIR filter design in the complex domain by a semi-infinite programming technique. I: The method , 1994 .

[17]  P. Heywood Trigonometric Series , 1968, Nature.

[18]  R. Reemtsen,et al.  Discretization methods for the solution of semi-infinite programming problems , 1991 .

[19]  Kenneth O. Kortanek Vector-Supercomputer Experiments with the Primal Affine Linear Programming Scaling Algorithm , 1993, SIAM J. Sci. Comput..

[20]  Mark J. T. Smith,et al.  Exact reconstruction techniques for tree-structured subband coders , 1986, IEEE Trans. Acoust. Speech Signal Process..

[21]  Georgios B. Giannakis,et al.  Principal component filter banks for optimal multiresolution analysis , 1995, IEEE Trans. Signal Process..

[22]  Truong Q. Nguyen,et al.  Improved technique for design of perfect reconstruction FIR QMF banks with lossless polyphase matrices , 1989, IEEE Trans. Acoust. Speech Signal Process..

[23]  P. R. Gribik,et al.  A central-cutting-plane algorithm for semi-infinite programming problems , 1979 .

[24]  HettichR.,et al.  Semi-infinite programming , 1979 .

[25]  Clifford T. Mullis,et al.  Synthesis of extremal wavelet-generating filters using Gaussian quadrature , 1995, IEEE Trans. Signal Process..

[26]  Jack Elzinga,et al.  A central cutting plane algorithm for the convex programming problem , 1975, Math. Program..

[27]  Benoit M. Macq,et al.  Signal-adapted multiresolution transform for image coding , 1992, IEEE Trans. Inf. Theory.

[28]  Michael Unser Extension of the Karhunen-Loeve transform for wavelets and perfect reconstruction filterbanks , 1993, Optics & Photonics.

[29]  Michael T. Orchard,et al.  Smooth wavelets, transform coding, and Markov-1 processes , 1993, IEEE Trans. Signal Process..

[30]  Klaus Glashoff,et al.  Linear Optimization and Approximation , 1983 .

[31]  Keh-Shew Lu,et al.  DIGITAL FILTER DESIGN , 1973 .

[32]  David G. Luenberger,et al.  Linear and nonlinear programming , 1984 .

[33]  Kenneth O. Kortanek,et al.  Numerical treatment of a class of semi‐infinite programming problems , 1973 .

[34]  L. Vanderdorpe CQF filter banks matched to signal statistics , 1992, Signal Process..

[35]  Kenneth O. Kortanek,et al.  Semi-Infinite Programming: Theory, Methods, and Applications , 1993, SIAM Rev..

[36]  Paul Jorgensen,et al.  Choosing discrete orthogonal wavelets for signal analysis and approximation , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[37]  Markus Lang,et al.  Polynomial root finding , 1994, IEEE Signal Processing Letters.

[38]  Yousef Saad,et al.  Hybrid Krylov Methods for Nonlinear Systems of Equations , 1990, SIAM J. Sci. Comput..

[39]  O. Rioul,et al.  A Remez exchange algorithm for orthonormal wavelets , 1994 .