A Deep Convolutional Neural Wavelet Network for Classification of Medical Images

This work present a new solution for medical image classification using the Neural Network (NN) and Wavelet Network (WN) based on the Fast Wavelet Transform (FWT) and the Adaboost algorithm. This method is divided in two stages: The learning stage and the classification stage. The first consists to extract the features using the FWT based on the MultiResolution Analysis (MRA). These features are used to calculate the inputs of the hidden layer. Then, those inputs are filtered by using the Adaboost algorithm to select the best ones corresponding to each image. The second consist to create an AutoEncoder (AE) using the best-selected wavelets of all images. Then, after a series of Stacked AE, a pooling is applied for each hidden layer to get our Convolutional Deep Neural Wavelet Network (CDNWN) architecture for the classification phase. Our experiments were performed on two different datasets and the obtained classifications rates given by our approach show a clear improvement compared to those cited in this article.

[1]  Chokri Ben Amar,et al.  A New Semantic Approach for CBIR Based on Beta Wavelet Network Modeling Shape Refined by Texture and Color Features , 2014, IDEAL.

[2]  Mourad Zaied,et al.  A dyadic multi-resolution deep convolutional neural wavelet network for image classification , 2018, Multimedia Tools and Applications.

[3]  Chokri Ben Amar,et al.  A Novel Approach for Face Recognition Based on Fast Learning Algorithm and Wavelet Network Theory , 2011, Int. J. Wavelets Multiresolution Inf. Process..

[4]  Weiyang Zhou,et al.  Verification of the nonparametric characteristics of backpropagation neural networks for image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[5]  Chokri Ben Amar,et al.  A hybrid approach for Content-Based Image Retrieval based on Fast Beta Wavelet network and fuzzy decision support system , 2016, Machine Vision and Applications.

[6]  Wim Sweldens,et al.  An Overview of Wavelet Based Multiresolution Analyses , 1994, SIAM Rev..

[7]  Ahmed Shaker,et al.  Structure-Based Neural Network Classification for Panchromatic IKONOS Image Using Wavelet-Based Features , 2011, 2011 Eighth International Conference Computer Graphics, Imaging and Visualization.

[8]  Rashad Al-Jawfi,et al.  Handwriting Arabic character recognition LeNet using neural network , 2009, Int. Arab J. Inf. Technol..

[9]  Chokri Ben Amar,et al.  Beta wavelets. Synthesis and application to lossy image compression , 2005, Adv. Eng. Softw..

[10]  Chokri Ben Amar,et al.  A Drowsy Driver Detection System Based on a New Method of Head Posture Estimation , 2014, IDEAL.

[11]  S. Sitharama Iyengar,et al.  Foundations of Wavelet Networks and Applications , 2002 .

[12]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[13]  Chokri Ben Amar,et al.  Dyadic Multi-resolution Analysis-Based Deep Learning for Arabic Handwritten Character Classification , 2015, 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI).

[14]  Ayoub Al-Hamadi,et al.  A Hidden Markov Model-Based Approach with an Adaptive Threshold Model for Off-Line Arabic Handwriting Recognition , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[15]  Jane You,et al.  HSAE: A Hessian regularized sparse auto-encoders , 2016, Neurocomputing.

[16]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[17]  Weifeng Liu,et al.  Canonical correlation analysis networks for two-view image recognition , 2017, Inf. Sci..

[18]  Cheng-Yuan Liou,et al.  Autoencoder for words , 2014, Neurocomputing.

[19]  Rim Zahmoul,et al.  Image encryption based on new Beta chaotic maps , 2017 .

[20]  Yann LeCun,et al.  Learning Invariant Feature Hierarchies , 2012, ECCV Workshops.

[21]  Yagyensh C. Pati,et al.  Analysis and synthesis of feedforward neural networks using discrete affine wavelet transformations , 1993, IEEE Trans. Neural Networks.

[22]  Chokri Ben Amar,et al.  FBWN: An architecture of fast beta wavelet networks for image classification , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[23]  Jing Wang,et al.  A fast deep learning system using GPU , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[24]  Chokri Ben Amar,et al.  A New Hand Posture Recognizer Based on Hybrid Wavelet Network Including a Fuzzy Decision Support System , 2014, IDEAL.

[25]  John Daugman,et al.  Demodulation by Complex-Valued Wavelets for Stochastic Pattern Recognition , 2003, Int. J. Wavelets Multiresolution Inf. Process..

[26]  Gershon Elber,et al.  Multiresolution Analysis , 2022 .

[27]  Adel M. Alimi,et al.  Impact of Character Models Choice on Arabic Text Recognition Performance , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[28]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[29]  Chokri Ben Amar,et al.  Intelligent Approach to Train Wavelet Networks for Recognition System of Arabic Words , 2010, KDIR.

[30]  M. Moraud.  Wavelet Networks , 2018, Foundations of Wavelet Networks and Applications.

[31]  Chokri Ben Amar,et al.  Fast Learning Algorithm of Wavelet Network Based on Fast Wavelet Transform , 2011, Int. J. Pattern Recognit. Artif. Intell..

[32]  Lee Luan Ling,et al.  Enhancing the Performance of AdaBoost Algorithms by Introducing a Frequency Counting Factor for Weight Distribution Updating , 2012, CIARP.

[33]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[34]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[35]  Chokri Ben Amar,et al.  Deep learning with shallow architecture for image classification , 2015, 2015 International Conference on High Performance Computing & Simulation (HPCS).

[36]  Gernot A. Fink,et al.  Markov models for offline handwriting recognition: a survey , 2009, International Journal on Document Analysis and Recognition (IJDAR).

[37]  Mourad Zaied,et al.  Supervised Image Classification Using Deep Convolutional Wavelets Network , 2015, 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI).

[38]  Yang Bingru,et al.  A Novel Word Based Arabic Handwritten Recognition System Using SVM Classifier , 2011, ICEC 2011.

[39]  László Tóth,et al.  Convolutional deep maxout networks for phone recognition , 2014, INTERSPEECH.

[40]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[41]  M. Zaied,et al.  Learning wavelet networks based on Multiresolution analysis: Application to images copy detection , 2011, International Conference on Communications, Computing and Control Applications.

[42]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[43]  Chokri Ben Amar,et al.  A speech recognition system based on hybrid wavelet network including a fuzzy decision support system , 2015, Other Conferences.

[44]  Chokri Ben Amar,et al.  Multi-input Multi-output Beta Wavelet Network: Modeling of Acoustic Units for Speech Recognition , 2012, ArXiv.

[45]  Mourad Zaied,et al.  GPU-based segmentation of dental X-ray images using active contours without edges , 2015, 2015 15th International Conference on Intelligent Systems Design and Applications (ISDA).

[46]  Mourad Zaied,et al.  Detection and Classification of Dental Caries in X-ray Images Using Deep Neural Networks , 2016, ICSEA 2016.

[47]  Chokri Ben Amar,et al.  Fast DCNN based on FWT, intelligent dropout and layer skipping for image retrieval , 2017, Neural Networks.

[48]  Harold H. Szu,et al.  Neural network adaptive wavelets for signal representation and classification , 1992 .

[49]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.