Efficient design of orthonormal wavelet bases for signal representation

The efficient representation of a signal as a linear combination of elementary "atoms" or building blocks is central to much signal processing theory and many applications. Wavelets provide a powerful, flexible, and efficiently implementable class of such atoms. In this paper, we develop an efficient method for selecting an orthonormal wavelet that is matched to a given signal in the sense that the squared error between the signal and some finite resolution wavelet representation of it is minimized. Since the squared error is not an explicit function of the design parameters, some form of approximation of this objective is required if conventional optimization techniques are to be used. Previous approximations have resulted in nonconvex optimization problems, which require delicate management of local minima. In this paper, we employ an approximation that results in a design problem that can be transformed into a convex optimization problem and efficiently solved. Constraints on the smoothness of the wavelet can be efficiently incorporated into the design. We show that the error incurred in our approximation is bounded by a function that decays to zero as the number of vanishing moments of the wavelet grows. In our examples, we demonstrate that our method provides wavelet bases that yield substantially better performance than members of standard wavelet families and are competitive with those designed by more intricate nonconvex optimization methods.

[1]  Truong Q. Nguyen,et al.  Wavelets and filter banks , 1996 .

[2]  P. P. Vaidyanathan,et al.  Theory of optimal orthonormal subband coders , 1998, IEEE Trans. Signal Process..

[3]  Paul Van Dooren,et al.  Convex optimization over positive polynomials and filter design , 2000 .

[4]  Charles A. Micchelli,et al.  Spectral factorization of Laurent polynomials , 1997, Adv. Comput. Math..

[5]  P. P. Vaidyanathan,et al.  Filterbank optimization with convex objectives and the optimality of principal component forms , 2001, IEEE Trans. Signal Process..

[6]  Stéphane Mallat,et al.  Zero-crossings of a wavelet transform , 1991, IEEE Trans. Inf. Theory.

[7]  Timothy N. Davidson,et al.  Wavelet packet division multiplexing and wavelet packet design under timing error effects , 1997, IEEE Trans. Signal Process..

[8]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[9]  Hagit Messer,et al.  Detection of a transient signal of unknown scaling and arrival time using the discrete wavelet transform , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[10]  Mihai Anitescu,et al.  The role of linear semi-infinite programming in signal-adapted QMF bank design , 1997, IEEE Trans. Signal Process..

[11]  W. Lawton Necessary and sufficient conditions for constructing orthonormal wavelet bases , 1991 .

[12]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[13]  Brian D. O. Anderson,et al.  Discrete positive-real fu nctions and their applications to system stability , 1969 .

[14]  Naoki Saito,et al.  Multiresolution representations using the auto-correlation functions of compactly supported wavelets , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Jamal Tuqan,et al.  A state space approach to the design of globally optimal FIR energy compaction filters , 2000, IEEE Trans. Signal Process..

[16]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[17]  Dennis M. Healy,et al.  Two applications of wavelet transforms in magnetic resonance imaging , 1992, IEEE Trans. Inf. Theory.

[18]  Michael Unser,et al.  On the optimality of ideal filters for pyramid and wavelet signal approximation , 1993, IEEE Trans. Signal Process..

[19]  Pierre Moulin,et al.  Theory and design of signal-adapted FIR paraunitary filter banks , 1998, IEEE Trans. Signal Process..

[20]  Lieven Vandenberghe,et al.  Interior-point methods for magnitude filter design , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[21]  Y. Meyer,et al.  Wavelets and Filter Banks , 1991 .

[22]  C. Burrus,et al.  Optimal wavelet representation of signals and the wavelet sampling theorem , 1994 .

[23]  Roberto H. Bamberger,et al.  FIR principal component filter banks , 1998, IEEE Trans. Signal Process..

[24]  Petre Stoica,et al.  On the parameterization of positive real sequences and MA parameter estimation , 2001, IEEE Trans. Signal Process..

[25]  Hideaki Sakai,et al.  Optimization of filter banks using cyclostationary spectral analysis , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[26]  Shubha Kadambe,et al.  Application of the wavelet transform for pitch detection of speech signals , 1992, IEEE Trans. Inf. Theory.

[27]  S. Mallat A wavelet tour of signal processing , 1998 .

[28]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[29]  Yinyu Ye,et al.  Interior point algorithms: theory and analysis , 1997 .

[30]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[31]  P. P. Vaidyanathan,et al.  Results on optimal biorthogonal filter banks , 1998 .

[32]  Stephen P. Boyd,et al.  FIR Filter Design via Spectral Factorization and Convex Optimization , 1999 .

[33]  R.N. Bracewell,et al.  Signal analysis , 1978, Proceedings of the IEEE.

[34]  Gregory W. Wornell Emerging applications of multirate signal processing and wavelets in digital communications , 1996 .

[35]  Zhi-Quan Luo,et al.  Design of orthogonal pulse shapes for communications via semidefinite programming , 2000, IEEE Trans. Signal Process..

[36]  Wayne Lawton,et al.  Multiresolution properties of the wavelet Galerkin operator , 1991 .

[37]  Zhi-Quan Luo,et al.  Linear matrix inequality formulation of spectral mask constraints with applications to FIR filter design , 2002, IEEE Trans. Signal Process..

[38]  Brian D. O. Anderson,et al.  Recursive algorithm for spectral factorization , 1974 .

[39]  B. Dumitrescu,et al.  Accurate computation of compaction filters with high regularity , 2002, IEEE Signal Processing Letters.

[40]  Naoki Saito,et al.  Multiresolution representations using the autocorrelation functions of compactly supported wavelets , 1993, IEEE Trans. Signal Process..

[41]  Michael G. Strintzis,et al.  Optimal biorthogonal wavelet bases for signal decomposition , 1996, IEEE Trans. Signal Process..

[42]  Georgios B. Giannakis,et al.  Principal component filter banks for optimal multiresolution analysis , 1995, IEEE Trans. Signal Process..

[43]  Deepen Sinha,et al.  On the optimal choice of a wavelet for signal representation , 1992, IEEE Trans. Inf. Theory.

[44]  C. S. Burrus,et al.  Wavelet transforms and filter banks , 1993 .

[45]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .