Detection of weather images by using spiking neural networks of deep learning models

The transmission of weather information of a location at certain time intervals affects the living conditions of the people there directly or indirectly. According to weather information, people shape their behavior in daily life. Besides, agricultural activities are carried out according to the weather conditions. Considering the importance of this subject, it is possible to make weather predictions based on the weather images in today’s technology exploiting the computer systems. However, the recent mention of the name of artificial intelligence technology in every field has made it compulsory for computer systems to benefit from this technology. The dataset used in the study has four classes: cloudy, rain, shine, and sunrise. In the study, GoogLeNet and VGG-16 models and the spiking neural network (SNN) were used together. The features extracted from GoogLeNet and VGG-16 models were combined and given to the SNNs as the input. As a result, the SNNs contributed to the success of classification with the proposed approach. The classification accuracy rates of cloudy, rain, shine, and sunrise classes were 98.48%, 97.58%, 97%, and 98.48%, respectively, together with SNN. Also, the use of SNNs in combination with deep learning models to obtain a successful result is proved in this study.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  AJAYI Gbeminiyi Oluwafemi,et al.  Multi-Class Weather Classification from Still Image Using Said Ensemble Method , 2019, 2019 Southern African Universities Power Engineering Conference/Robotics and Mechatronics/Pattern Recognition Association of South Africa (SAUPEC/RobMech/PRASA).

[3]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[4]  Arnold Schumann,et al.  Chemical crystal identification with deep learning machine vision , 2018, BMC Research Notes.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Romain Brette,et al.  Brian 2, an intuitive and efficient neural simulator , 2019, eLife.

[8]  Hyunchul Shin,et al.  Weather Classification using Convolutional Neural Networks , 2018, 2018 International SoC Design Conference (ISOCC).

[9]  Albert Bifet,et al.  Spiking Neural Networks and Online Learning: An Overview and Perspectives , 2019, Neural Networks.

[10]  Debdoot Sheet,et al.  Simultaneous localization and classification of acute lymphoblastic leukemic cells in peripheral blood smears using a deep convolutional network with average pooling layer , 2017, 2017 IEEE International Conference on Industrial and Information Systems (ICIIS).

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Shivajirao M. Jadhav,et al.  Deep convolutional neural network based medical image classification for disease diagnosis , 2019, Journal of Big Data.

[13]  Ahmed M. Elgammal,et al.  Weather classification with deep convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[14]  Zafer Cömert,et al.  Waste classification using AutoEncoder network with integrated feature selection method in convolutional neural network models , 2020 .

[15]  Peter Richtárik,et al.  Semi-Stochastic Gradient Descent Methods , 2013, Front. Appl. Math. Stat..

[16]  Burhan Ergen,et al.  Subclass Separation of White Blood Cell Images Using Convolutional Neural Network Models , 2019, Elektronika ir Elektrotechnika.

[17]  Narasimhan Sundararajan,et al.  SEFRON: A New Spiking Neuron Model With Time-Varying Synaptic Efficacy Function for Pattern Classification , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Yang Wang,et al.  Applications of Support Vector Machine (SVM) Learning in Cancer Genomics. , 2018, Cancer genomics & proteomics.

[19]  Malu Zhang,et al.  An Efficient Supervised Training Algorithm for Multilayer Spiking Neural Networks , 2016, PloS one.

[20]  Burhan Ergen,et al.  Diagnosis of Eye Retinal Diseases Based on Convolutional Neural Networks Using Optical Coherence Images , 2019, 2019 23rd International Conference Electronics.

[21]  Rahul Khanna,et al.  Support Vector Machines for Classification , 2015 .

[22]  Li Shen,et al.  A Sufficient Condition for Convergences of Adam and RMSProp , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Timothée Masquelier,et al.  Deep Learning in Spiking Neural Networks , 2018, Neural Networks.

[24]  Zafer Cömert,et al.  BreastNet: A novel convolutional neural network model through histopathological images for the diagnosis of breast cancer , 2020 .

[25]  Zhiyong Zhao,et al.  Support Vector Machine based Differential Pulse-width Pair Brillouin Optical Time Domain Analyzer , 2018, IEEE Photonics Journal.

[26]  Gang Pan,et al.  CSNN: An Augmented Spiking based Framework with Perceptron-Inception , 2018, IJCAI.

[27]  Aruna Govada,et al.  Centroid based Binary Tree Structured SVM for multi classification , 2015, 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[28]  Stephen Marshall,et al.  Activation Functions: Comparison of trends in Practice and Research for Deep Learning , 2018, ArXiv.

[29]  Xiao Fu.  Application of Artificial Intelligence Technology in Medical Cell Biology , 2019, 2019 International Conference on Robots & Intelligent System (ICRIS).

[30]  Deepak Khosla,et al.  Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition , 2014, International Journal of Computer Vision.

[31]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[32]  Rustam Stolkin,et al.  Weather Classification: A new multi-class dataset, data augmentation approach and comprehensive evaluations of Convolutional Neural Networks , 2018, 2018 NASA/ESA Conference on Adaptive Hardware and Systems (AHS).

[33]  Cewu Lu,et al.  Two-Class Weather Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Burhan Ergen,et al.  Classification of flower species by using features extracted from the intersection of feature selection methods in convolutional neural network models , 2020 .

[35]  Xuelong Li,et al.  A CNN-RNN architecture for multi-label weather recognition , 2018, Neurocomputing.

[36]  Jong-Ho Lee,et al.  Adaptive learning rule for hardware-based deep neural networks using electronic synapse devices , 2018, Neural Computing and Applications.

[37]  Yili Qu,et al.  A Solution for Input Limit in CNN Due to Fully-Connected Layer , 2018, 2018 IEEE 9th International Conference on Software Engineering and Service Science (ICSESS).

[38]  Gopi Battineni,et al.  Machine learning in medicine: Performance calculation of dementia prediction by support vector machines (SVM) , 2019, Informatics in Medicine Unlocked.

[39]  Warren J. Gross,et al.  Power Reduction in CNN Pooling Layers with a Preliminary Partial Computation Strategy , 2018, 2018 16th IEEE International New Circuits and Systems Conference (NEWCAS).

[40]  Imran Sharif,et al.  A multiseed-based SVM classification technique for training sample reduction , 2019 .

[41]  Andrea. Renda,et al.  Artificial Intelligence Ethics, governance and policy challenges. Report of a CEPS Task Force, February 2019 , 2019 .

[42]  Yoshihiro Shima,et al.  Image Augmentation for Object Image Classification Based On Combination of Pre-Trained CNN and SVM , 2018 .

[43]  Xiaochao Dang,et al.  A Delay Learning Algorithm Based on Spike Train Kernels for Spiking Neurons , 2019, Front. Neurosci..

[44]  A S Spinelli,et al.  Computing of temporal information in spiking neural networks with ReRAM synapses , 2018, Faraday discussions.

[45]  Wei Wang,et al.  Sparse Orthogonal Circulant Transform Multiplexing for Coherent Optical Fiber Communication , 2018, IEEE Photonics Journal.

[46]  Muhammad Hanif Durad,et al.  Intrusion detection using deep sparse auto-encoder and self-taught learning , 2019, Neural Computing and Applications.

[47]  Christian Igel,et al.  A Unified View on Multi-class Support Vector Classification , 2016, J. Mach. Learn. Res..

[48]  Mesut Toğaçar,et al.  Chronic Tympanic Membrane Diagnosis based on Deep Convolutional Neural Network , 2019, 2019 4th International Conference on Computer Science and Engineering (UBMK).

[49]  Tobias Senst,et al.  Hyper-parameter optimization for convolutional neural network committees based on evolutionary algorithms , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[50]  Cömert Zafer,et al.  Fusing fine-tuned deep features for recognizing different tympanic membranes , 2020 .