Hierarchical extreme learning machine based image denoising network for visual Internet of Things

Abstract In the visual Internet of Things (VIoT), imaging sensors must achieve a balance between limited bandwidth and useful information when images contain heavy noise. In this paper, we address the problem of removing heavy noise and propose a novel hierarchical extreme learning machine-based image denoising network, which comprises a sparse auto-encoder and a supervised regression. Due to the fast training of a hierarchical extreme learning machine, an effective image denoising system that is robust for various noise levels can be trained more efficiently than other denoising methods, using a deep neural network. Our proposed framework also contains a non-local aggregation procedure that aims to fine-tune noise reduction according to structural similarity. Compared to the compression ratio in noisy images, the compression ratio of denoised images can be dramatically improved. Therefore, the method can achieve a low communication cost for data interactions in the VIoT. Experimental studies on images, including both hand-written digits and natural scenes, have demonstrated that the proposed technique achieves excellent performance in suppressing heavy noise. Further, it greatly reduces the training time, and outperforms other state-of-the-art approaches in terms of denoising indexes for the peak signal-to-noise ratio (PSNR) or the structural similarity index (SSIM).

[1]  C. Enz,et al.  Temporal Readout Noise Analysis and Reduction Techniques for Low-Light CMOS Image Sensors , 2016, IEEE Transactions on Electron Devices.

[2]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[3]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[4]  Raymond F. Muzic,et al.  A semi-local paradigm for wavelet denoising , 2006, IEEE Transactions on Image Processing.

[5]  Ligang Liu,et al.  3D Shape Segmentation and Labeling via Extreme Learning Machine , 2014, Comput. Graph. Forum.

[6]  M. L. Dewal,et al.  Medical image denoising using adaptive fusion of curvelet transform and total variation , 2013, Comput. Electr. Eng..

[7]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[8]  Xiaohui Chang,et al.  A large-scale web QoS prediction scheme for the Industrial Internet of Things based on a kernel machine learning algorithm , 2016, Comput. Networks.

[9]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[10]  Thomas W. Parks,et al.  Adaptive principal components and image denoising , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[11]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[12]  Shivank Dhote,et al.  Using FPGA-SoC interface for low cost IoT based image processing , 2016, 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[13]  Fuzhen Zhuang,et al.  Parallel extreme learning machine for regression based on MapReduce , 2013, Neurocomputing.

[14]  Qingwu Li,et al.  Road Vehicle Monitoring System Based on Intelligent Visual Internet of Things , 2015, J. Sensors.

[15]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[16]  Anat Levin,et al.  Natural image denoising: Optimality and inherent bounds , 2011, CVPR 2011.

[17]  M. Brand,et al.  Fast low-rank modifications of the thin singular value decomposition , 2006 .

[18]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Lei Xie,et al.  An ensemble of deep neural networks for object tracking , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[20]  Peng Li,et al.  Deep Convolutional Computation Model for Feature Learning on Big Data in Internet of Things , 2018, IEEE Transactions on Industrial Informatics.

[21]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[22]  Ping-Sing Tsai,et al.  JPEG: Still Image Compression Standard , 2005 .

[23]  Yu Xue,et al.  Research on denoising sparse autoencoder , 2016, International Journal of Machine Learning and Cybernetics.

[24]  Xiaolan Fu,et al.  Face Recognition and Micro-expression Recognition Based on Discriminant Tensor Subspace Analysis Plus Extreme Learning Machine , 2014, Neural Processing Letters.

[25]  Houqiang Li,et al.  A new non-local video denoising scheme using low-rank representation and total variation regularization , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[26]  Hossam Faris,et al.  Metaheuristic-based extreme learning machines: a review of design formulations and applications , 2018, Int. J. Mach. Learn. Cybern..

[27]  Jiang Yue,et al.  Local Sparse Structure Denoising for Low-Light-Level Image , 2015, IEEE Transactions on Image Processing.

[28]  Diego López-de-Ipiña,et al.  ARIIMA: A Real IoT Implementation of a Machine-Learning Architecture for Reducing Energy Consumption , 2014, UCAmI.

[29]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[30]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[31]  Lisha Hu,et al.  OKRELM: online kernelized and regularized extreme learning machine for wearable-based activity recognition , 2018, Int. J. Mach. Learn. Cybern..

[32]  Nicholas D. Lane,et al.  An Early Resource Characterization of Deep Learning on Wearables, Smartphones and Internet-of-Things Devices , 2015, IoT-App@SenSys.

[33]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[34]  Peyman Milanfar,et al.  Global Image Denoising , 2014, IEEE Transactions on Image Processing.

[35]  Ming-Yu Liu,et al.  Deep Gaussian Conditional Random Field Network: A Model-Based Deep Network for Discriminative Denoising , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  R. L. White,et al.  Lossless Astronomical Image Compression and the Effects of Noise , 2009, 0903.2140.

[37]  Katherine Guo,et al.  Precog: prefetching for image recognition applications at the edge , 2017, SEC.

[38]  A. K. Rigler,et al.  Accelerating the convergence of the back-propagation method , 1988, Biological Cybernetics.

[39]  Pramode K. Verma,et al.  An efficient video denoising method using decomposition approach for low-rank matrix completion , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[40]  Michael Elad,et al.  Learning Multiscale Sparse Representations for Image and Video Restoration , 2007, Multiscale Model. Simul..

[41]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[42]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[43]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[44]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Fuchun Sun,et al.  Local receptive field based extreme learning machine with three channels for histopathological image classification , 2019, Int. J. Mach. Learn. Cybern..

[47]  Paolo Gastaldo,et al.  Efficient Digital Implementation of Extreme Learning Machines for Classification , 2012, IEEE Transactions on Circuits and Systems II: Express Briefs.

[48]  Swati Kumari,et al.  Challenging Issues of Video Surveillance System Using Internet of Things in Cloud Environment , 2016 .

[49]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[50]  Erkki Oja,et al.  GPU-accelerated and parallelized ELM ensembles for large-scale regression , 2011, Neurocomputing.

[51]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[52]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[54]  Karen O. Egiazarian,et al.  Image restoration by sparse 3D transform-domain collaborative filtering , 2008, Electronic Imaging.

[55]  M. Omair Ahmad,et al.  A study on image denoising in contourlet domain using the alpha-stable family of distributions , 2016, Signal Process..

[56]  Ciprian Dobre,et al.  Big Data and Internet of Things: A Roadmap for Smart Environments , 2014, Big Data and Internet of Things.