A state space approach to the design of globally optimal FIR energy compaction filters

We introduce a new approach for the least squared optimization of a weighted FIR filter of arbitrary order N under the constraint that its magnitude squared response be Nyquist(M). Although the new formulation is general enough to cover a wide variety of applications, the focus of the paper is on optimal energy compaction filters. The optimization of such filters has received considerable attention in the past due to the fact that they are the main building blocks in the design of principal component filter banks (PCFBs). The newly proposed method finds the optimum product filter F/sub opt/(z)=H/sub opt/(Z)H/sub opt/(z/sup -1/) corresponding to the compaction filter H/sub opt/(z). By expressing F(z) in the form D(z)+D(z/sup -1/), we show that the compaction problem can be completely parameterized in terms of the state-space realization of the causal function D(z). For a given input power spectrum, the resulting filter F/sub opt/(z) is guaranteed to be a global optimum solution due to the convexity of the new formulation. The new algorithm is universal in the sense that it works for any M, arbitrary filter length N, and any given input power spectrum. Furthermore, additional linear constraints such as wavelets regularity constraints can be incorporated into the design problem. Finally, obtaining H/sub opt/(z) from F/sub opt/(z) does not require an additional spectral factorization step. The minimum-phase spectral factor H/sub min/(z) can be obtained automatically by relating the state space realization of D/sub opt/(z) to that of H/sub opt/(z).

[1]  J. Tuqan Global optimization of orthogonal FIR transmitter and receiver filters for data transmission over noisy channels , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[2]  Mihai Anitescu,et al.  The role of linear semi-infinite programming in signal-adapted QMF bank design , 1997, IEEE Trans. Signal Process..

[3]  B. Xuan,et al.  Complete FIR principal component filter banks , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[4]  K. H. Barratt Digital Coding of Waveforms , 1985 .

[5]  Michael Unser,et al.  On the optimality of ideal filters for pyramid and wavelet signal approximation , 1993, IEEE Trans. Signal Process..

[6]  E. Yaz Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[7]  L. Vanderdorpe CQF filter banks matched to signal statistics , 1992, Signal Process..

[8]  P. P. Vaidyanathan,et al.  Globally optimal FIR filters with applications in source and channel coding , 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

[9]  P. P. Vaidyanathan,et al.  On optimization of filter banks with denoising applications , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[10]  P. P. Vaidyanathan,et al.  On existence of FIR principal component filter banks , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[11]  G. Ungerboeck,et al.  Optimum FIR Transmitter and Receiver Filters for Data Transmission Over Band-Limited Channels , 1982, IEEE Trans. Commun..

[12]  Georgios B. Giannakis,et al.  Principal component filter banks for optimal multiresolution analysis , 1995, IEEE Trans. Signal Process..

[13]  P. P. Vaidyanathan,et al.  Theory of optimal orthonormal subband coders , 1998, IEEE Trans. Signal Process..

[14]  Thomas Kailath,et al.  Linear Systems , 1980 .

[15]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[16]  Clifford T. Mullis,et al.  Synthesis of extremal wavelet-generating filters using Gaussian quadrature , 1995, IEEE Trans. Signal Process..

[17]  P. P. Vaidyanathan,et al.  Globally optimal two channel FIR orthonormal filter banks adapted to the input signal statistics , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[18]  B. Anderson Algebraic properties of minimal degree spectral factors , 1973 .

[19]  Yipeng Liu,et al.  Statistically optimized PR-QMF design , 1991, Other Conferences.

[20]  P. P. Vaidyanathan,et al.  Oversampling PCM techniques and optimum noise shapers for quantizing a class of nonbandlimited signals , 1999, IEEE Trans. Signal Process..

[21]  Truong Q. Nguyen,et al.  Improved technique for design of perfect reconstruction FIR QMF banks with lossless polyphase matrices , 1989, IEEE Trans. Acoust. Speech Signal Process..

[22]  P. P. Vaidyanathan,et al.  Lattice structures for optimal design and robust implementation of two-channel perfect-reconstruction QMF banks , 1988, IEEE Trans. Acoust. Speech Signal Process..

[23]  Avideh Zakhor,et al.  A multi-start algorithm for signal adaptive subband systems (image coding) , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[24]  P. Vaidyanathan Multirate Systems And Filter Banks , 1992 .

[25]  A. Antoniou,et al.  Optimized orthogonal and biorthogonal wavelets using linear parameterization of halfband filters , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[26]  J. Willems Least squares stationary optimal control and the algebraic Riccati equation , 1971 .

[27]  Zhi-Quan Luo,et al.  Optimum filter banks for signal decomposition and its application in adaptive echo cancellation , 1996, IEEE Trans. Signal Process..

[28]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[29]  J. W. Brown,et al.  Complex Variables and Applications , 1985 .

[30]  J. Tuqan On the design of optimal orthogonal finite order transmitter and receiver filters for data transmission over noisy channels , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[31]  Michael G. Strintzis,et al.  Optimal biorthogonal wavelet bases for signal decomposition , 1996, IEEE Trans. Signal Process..

[32]  Pierre Moulin,et al.  Theory and design of signal-adapted FIR paraunitary filter banks , 1998, IEEE Trans. Signal Process..

[33]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[34]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[35]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[36]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .

[37]  Patrick L. Combettes,et al.  Wavelet synthesis by alternating projections , 1996, IEEE Trans. Signal Process..

[38]  Michael Unser Extension of the Karhunen-Loeve transform for wavelets and perfect reconstruction filterbanks , 1993, Optics & Photonics.

[39]  M Gerassimos Strintzis Optimal pyramidal and subband decompositions for hierarchical coding of noisy and quantized images. , 1998, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[40]  Benoit M. Macq,et al.  Signal-adapted multiresolution transform for image coding , 1992, IEEE Trans. Inf. Theory.

[41]  Brian D. O. Anderson,et al.  Discrete positive-real fu nctions and their applications to system stability , 1969 .

[42]  Stephen P. Boyd,et al.  FIR filter design via semidefinite programming and spectral factorization , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[43]  Georgios B. Giannakis,et al.  Time-varying system identification and model validation using wavelets , 1993, IEEE Trans. Signal Process..

[44]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[45]  J. Tuqan,et al.  The role of the discrete-time Kalman-Yakubovitch-Popov lemma in designing statistically optimum FIR orthonormal filter banks , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[46]  P. P. Vaidyanathan,et al.  Theory and design of optimum FIR compaction filters , 1998, IEEE Trans. Signal Process..