Results on principal component filter banks: Colored noise suppression and existence issues

We have made explicit the precise connection between the optimization of orthonormal filter banks (FBs) and the principal component property: the principal component filter bank (PCFB) is optimal whenever the minimization objective is a concave function of the subband variances of the FB. This explains PCFB optimality for compression, progressive transmission, and various hitherto unnoticed white-noise, suppression applications such as subband Wiener filtering. The present work examines the nature of the FB optimization problems for such schemes when PCFBs do not exist. Using the geometry of the optimization search spaces, we explain exactly why these problems are usually analytically intractable. We show the relation between compaction filter design (i.e., variance maximization) and optimum FBs. A sequential maximization of subband variances produces a PCFB if one exists, but is otherwise suboptimal for several concave objectives. We then study PCFB optimality for colored noise suppression. Unlike the case when the noise is white, here the minimization objective is a function of both the signal and the noise subband variances. We show that for the transform coder class, if a common signal and noise PCFB (KLT) exists, it is, optimal for a large class of concave objectives. Common PCFBs for general FB classes have a considerably more restricted optimality, as we show using the class of unconstrained orthonormal FBs. For this class, we also show how to find an optimum FB when the signal and noise spectra are both piecewise constant with all discontinuities at rational multiples of /spl pi/.

[1]  J. O´Rourke,et al.  Computational Geometry in C: Arrangements , 1998 .

[2]  Georgios B. Giannakis,et al.  Principal component filter banks for optimal multiresolution analysis , 1995, IEEE Trans. Signal Process..

[3]  P. Schultheiss,et al.  Block Quantization of Correlated Gaussian Random Variables , 1963 .

[4]  P. P. Vaidyanathan,et al.  The best basis problem, compaction problem and PCFB design problems [filter banks] , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[5]  P. P. Vaidyanathan,et al.  Filterbank optimization with convex objectives and the optimality of principal component forms , 2001, IEEE Trans. Signal Process..

[6]  P. P. Vaidyanathan,et al.  Theory and design of optimum FIR compaction filters , 1998, IEEE Trans. Signal Process..

[7]  P. Vaidyanathan.  Multirate Systems And Filter Banks , 1992 .

[8]  Peter Gritzmann,et al.  Minkowski Addition of Polytopes: Computational Complexity and Applications to Gröbner Basis , 1993, SIAM J. Discret. Math..

[9]  P. P. Vaidyanathan,et al.  On existence of FIR principal component filter banks , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[10]  P. P. Vaidyanathan,et al.  Results on optimal biorthogonal filter banks , 1998 .

[11]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[12]  Irving Kalet,et al.  The multitone channel , 1989, IEEE Trans. Commun..

[13]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[14]  P. P. Vaidyanathan,et al.  Theory of optimal orthonormal subband coders , 1998, IEEE Trans. Signal Process..

[15]  S. Akkarakaran,et al.  Optimized orthonormal transforms for SNR improvement by subband processing , 1999, 1999 2nd IEEE Workshop on Signal Processing Advances in Wireless Communications (Cat. No.99EX304).

[16]  Michael Unser.  Extension of the Karhunen-Loeve transform for wavelets and perfect reconstruction filterbanks , 1993, Optics & Photonics.

[17]  Pierre Moulin,et al.  Theory and design of signal-adapted FIR paraunitary filter banks , 1998, IEEE Trans. Signal Process..

[18]  Joseph O'Rourke,et al.  Computational Geometry in C. , 1995 .

[19]  Dimitri P. Bertsekas,et al.  The Auction Algorithm for Assignment and Other Network Flow Problems: A Tutorial , 1990 .

[20]  P. P. Vaidyanathan,et al.  OPTIMALITY OF ORTHONORMAL TRANSFORMS FOR SUBBAND CODING , 1998 .

[21]  P. P. Vaidyanathan,et al.  Optimality of principal component filter banks for discrete multitone communication systems , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[22]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[23]  Mihai Anitescu,et al.  Theory of rate-distortion-optimal, constrained filterbanks-application to IIR and FIR biorthogonal designs , 2000, IEEE Trans. Signal Process..