Pyramidal Hybrid Approach: Wavelet Network with OLS Algorithm-Based Image Classification

Taking advantage of both the scaling property of wavelets and the high learning ability of neural networks, wavelet networks have recently emerged as a powerful tool in many applications in the field of signal processing such as data compression, function approximation as well as image recognition and classification. A novel wavelet network-based method for image classification is presented in this paper. The method combines the Orthogonal Least Squares algorithm (OLS) with the Pyramidal Beta Wavelet Network architecture (PBWN). First, the structure of the Pyramidal Beta Wavelet Network is proposed and the OLS method is used to design it by presetting the widths of the hidden units in PBWN. Then, to enhance the performance of the obtained PBWN, a novel learning algorithm based on orthogonal least squares and frames theory is proposed, in which we use OLS to select the hidden nodes. In the simulation part, the proposed method is employed to classify colour images. Comparisons with some typical wavelet networks are presented and discussed. Simulations also show that the PBWN-orthogonal least squares (PBWN-OLS) algorithm, which combines PBWN with the OLS algorithm, results in better performance for colour image classification.

[1]  Martin Ehler,et al.  Compactly Supported Multivariate, Pairs of Dual Wavelet Frames Obtained by Convolution , 2008, Int. J. Wavelets Multiresolution Inf. Process..

[2]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Brian A. Telfer,et al.  Wavelet transforms and neural networks for compression and recognition , 1996, Neural Networks.

[4]  Abdulkadir Sengür,et al.  Wavelet packet neural networks for texture classification , 2007, Expert Syst. Appl..

[5]  Chng Eng Siong,et al.  Efficient computational schemes for the orthogonal least squares algorithm , 1995, IEEE Trans. Signal Process..

[6]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[7]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[8]  H.H. Yang,et al.  Orthogonal least-squares learning algorithm with local adaptation process for the radial basis function networks , 1996, IEEE Signal Processing Letters.

[9]  Zhiguo Zhang.  Iterative algorithm of wavelet network learning from nonuniform data , 2009, Neurocomputing.

[10]  Engin Avci,et al.  Intelligent target recognition based on wavelet packet neural network , 2005, Expert Syst. Appl..

[11]  Harold H. Szu,et al.  Neural network adaptive wavelets for signal representation and classification , 1992 .

[12]  Chokri Ben Amar,et al.  Beta Wavelet Networks for Face Recognition , 2005, J. Decis. Syst..

[13]  Qinghua Zhang,et al.  Using wavelet network in nonparametric estimation , 1997, IEEE Trans. Neural Networks.

[14]  Chokri Ben Amar,et al.  Beta wavelets. Synthesis and application to lossy image compression , 2005, Adv. Eng. Softw..

[15]  Christine Solnon,et al.  Classification of Images Based on Hidden Markov Models , 2009, 2009 Seventh International Workshop on Content-Based Multimedia Indexing.

[16]  Ahmet Arslan,et al.  An intelligent system for diagnosis of the heart valve diseases with wavelet packet neural networks , 2003, Comput. Biol. Medicine.

[17]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[18]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[19]  Zhiguo Zhang,et al.  Learning algorithm of wavelet network based on sampling theory , 2007, Neurocomputing.

[20]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[21]  Yan Li,et al.  A new discrete wavelet transform fast algorithm with rational dilation factor , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[22]  Cheng-Jian Lin.  Wavelet Neural Networks with a Hybrid Learning Approach , 2006, J. Inf. Sci. Eng..

[23]  Gilles Vaucher,et al.  Compression d'images et réseaux de neurones , 2001 .

[24]  Dingli Yu,et al.  Selecting radial basis function network centers with recursive orthogonal least squares training , 2000, IEEE Trans. Neural Networks Learn. Syst..

[25]  Cheng-Wu Chen,et al.  Improving the generalization performance of RBF neural networks using a linear regression technique , 2009, Expert Syst. Appl..

[26]  Xiaodong Li,et al.  Modeling of a permeate flux of cross-flow membrane filtration of colloidal suspensions: A wavelet network approach , 2009 .

[27]  Sheng Chen,et al.  Regularized orthogonal least squares algorithm for constructing radial basis function networks , 1996 .

[28]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[29]  Robert X. Gao,et al.  Base Wavelet Selection for Bearing Vibration Signal Analysis , 2009, Int. J. Wavelets Multiresolution Inf. Process..

[30]  Chokri Ben Amar,et al.  A New Structure and Training Procedure for Multi-Mother Wavelet Networks , 2010, Int. J. Wavelets Multiresolution Inf. Process..

[31]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  C. Ben Amar,et al.  Training of the Beta wavelet networks by the frames theory: Application to face recognition , 2008, 2008 First Workshops on Image Processing Theory, Tools and Applications.

[33]  Chokri Ben Amar,et al.  Fast and efficient 3D face recognition using wavelet networks , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[34]  Yacine Oussar,et al.  Reseaux d'ondelettes et reseaux de neurones pour la modelisation statique et dynamique de processus , 1998 .