Deep wavelet network for image classification

The success of the deep learning and specifically learning layer by layer led to many impressive results in several contexts that include neural network. This gave us the idea to apply this principle of learning on wavelet network because it is an active research topic at the moment. This paper present our approach for image classification by the combination of two techniques of learning: the wavelet network and the deep learning. We try to classify images in a supervised way following by an unsupervised learning using the principle of autoencoder. Experiments on two databases COIL-100 and MNIST show that our approach gives good results for the two classifiers that we used.

[1]  Xiangjian He,et al.  Classification Techniques in Pattern Recognition , 2005 .

[2]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[3]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[4]  Jun Zeng,et al.  Artificial neural network model for identifying taxi gross emitter from remote sensing data of vehicle emission. , 2007, Journal of environmental sciences.

[5]  Qinghua Zhang,et al.  Using wavelet network in nonparametric estimation , 1997, IEEE Trans. Neural Networks.

[6]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[7]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[8]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[9]  Vivek Agarwal,et al.  Survey on Classification Techniques for Data Mining , 2015 .

[10]  Brian A. Telfer,et al.  Wavelet transforms and neural networks for compression and recognition , 1996, Neural Networks.

[11]  Chokri Ben Amar,et al.  Feature Vector Approximation based on Wavelet Network , 2016, ICAART.

[12]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[13]  Chokri Ben Amar,et al.  Classification improvement of local feature vectors over the KNN algorithm , 2011, Multimedia Tools and Applications.

[14]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[15]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[16]  Olivier Sigaud,et al.  Learning a repertoire of actions with deep neural networks , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[17]  M. Moraud.  Wavelet Networks , 2018, Foundations of Wavelet Networks and Applications.

[18]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[20]  A. Kannan,et al.  Color Image Classification and Retrieval using Image mining Techniques 1 , 2010 .

[21]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  J. H. Ward.  Hierarchical Grouping to Optimize an Objective Function , 1963 .

[23]  Harold H. Szu,et al.  Neural network adaptive wavelets for signal representation and classification , 1992 .

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[26]  Jaime Gomez-Gil,et al.  Leaf classification in sunflower crops by computer vision and neural networks , 2011 .

[27]  Mourad Zaied,et al.  A deep convolutional neural wavelet network to supervised Arabic letter image classification , 2015, 2015 15th International Conference on Intelligent Systems Design and Applications (ISDA).

[28]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[29]  Jing Wang,et al.  A fast deep learning system using GPU , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[30]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[31]  Yann LeCun,et al.  Learning Invariant Feature Hierarchies , 2012, ECCV Workshops.

[32]  Cheng-Yuan Liou,et al.  Autoencoder for words , 2014, Neurocomputing.

[33]  Martin Brown,et al.  Linear spectral mixture models and support vector machines for remote sensing , 2000, IEEE Trans. Geosci. Remote. Sens..

[34]  Frederick Kaefer,et al.  A neural network application to consumer classification to improve the timing of direct marketing activities , 2005, Comput. Oper. Res..

[35]  Yu-Liang Hsu,et al.  ECG arrhythmia classification using a probabilistic neural network with a feature reduction method , 2013, Neurocomputing.

[36]  L. S. Davis,et al.  An assessment of support vector machines for land cover classi(cid:142) cation , 2002 .

[37]  Pascal Vincent,et al.  The Difficulty of Training Deep Architectures and the Effect of Unsupervised Pre-Training , 2009, AISTATS.

[38]  Jawad Iounousse,et al.  Unsupervised classification of grayscale image using Probabilistic Neural Network (PNN) , 2012, 2012 International Conference on Multimedia Computing and Systems.

[39]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[40]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..