Toward Edge-Based Deep Learning in Industrial Internet of Things

As a typical application of the Internet of Things (IoT), the Industrial IoT (IIoT) connects all the related IoT sensing and actuating devices ubiquitously so that the monitoring and control of numerous industrial systems can be realized. Deep learning, as one viable way to carry out big-data-driven modeling and analysis, could be integrated in IIoT systems to aid the automation and intelligence of IIoT systems. As deep learning requires large computation power, it is commonly deployed in cloud servers. Thus, the data collected by IoT devices must be transmitted to the cloud for training process, contributing to network congestion and affecting the IoT network performance as well as the supported applications. To address this issue, in this article, we leverage the fog/edge computing paradigm and propose an edge computing-based deep learning model, which utilizes edge computing to migrate the deep learning process from cloud servers to edge nodes, reducing data transmission demands in the IIoT network and mitigating network congestion. Since edge nodes have limited computation ability compared to servers, we design a mechanism to optimize the deep learning model so that its requirements for computational power can be reduced. To evaluate our proposed solution, we design a testbed implemented in the Google cloud and deploy the proposed convolutional neural network (CNN) model, utilizing a real-world IIoT data set to evaluate our approach.1 Our experimental results confirm the effectiveness of our approach, which cannot only reduce the network traffic overhead for IIoT but also maintain the classification accuracy in comparison with several baseline schemes.1Certain commercial equipment, instruments, or materials are identified in this article in order to specify the experimental procedure adequately. Such identification is not intended to imply recommendation or endorsement by the National Institute of Standards and Technology, nor is it intended to imply that the materials or equipment identified are necessarily the best available for the purpose.

[1]  Christian Brecher,et al.  Industrial Internet of Things and Cyber Manufacturing Systems , 2017 .

[2]  Yonghui Song,et al.  A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things , 2018, IEEE Internet of Things Journal.

[3]  Peng Li,et al.  An Adaptive Dropout Deep Computation Model for Industrial IoT Big Data Learning With Crowdsourcing to Cloud Computing , 2019, IEEE Transactions on Industrial Informatics.

[4]  Andrew Y. C. Nee,et al.  Digital twin-driven product design framework , 2019, Int. J. Prod. Res..

[5]  Jiangchuan Liu,et al.  When deep learning meets edge computing , 2017, 2017 IEEE 25th International Conference on Network Protocols (ICNP).

[6]  Jiafu Wan,et al.  Adaptive Transmission Optimization in SDN-Based Industrial Internet of Things With Edge Computing , 2018, IEEE Internet of Things Journal.

[7]  Nada Golmie,et al.  Ultra-Dense Networks: Survey of State of the Art and Future Directions , 2016, 2016 25th International Conference on Computer Communication and Networks (ICCCN).

[8]  Jason Cong,et al.  Energy-Efficient CNN Implementation on a Deeply Pipelined FPGA Cluster , 2016, ISLPED.

[9]  Manolis I. A. Lourakis,et al.  T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-Less Objects , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[10]  Nikos Komodakis,et al.  Object Detection via a Multi-region and Semantic Segmentation-Aware CNN Model , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Mohsen Guizani,et al.  Deep Learning for IoT Big Data and Streaming Analytics: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[12]  Hazem M. El-Bakry,et al.  CNN for Handwritten Arabic Digits Recognition Based on LeNet-5 , 2016, AISI.

[13]  Xinyu Yang,et al.  A Survey on the Edge Computing for the Internet of Things , 2018, IEEE Access.

[14]  Ananthram Swami,et al.  The Limitations of Deep Learning in Adversarial Settings , 2015, 2016 IEEE European Symposium on Security and Privacy (EuroS&P).

[15]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Xinyu Yang,et al.  A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications , 2017, IEEE Internet of Things Journal.

[17]  Abhishek Verma,et al.  Compressed residual-VGG16 CNN model for big data places image recognition , 2018, 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC).

[18]  Xing Liu,et al.  Secure Internet of Things (IoT)-Based Smart-World Critical Infrastructures: Survey, Case Study and Research Opportunities , 2019, IEEE Access.

[19]  Sabina Jeschke,et al.  Industrial Internet of Things: Cybermanufacturing Systems , 2016 .

[20]  Fernando M. V. Ramos,et al.  Software-Defined Networking: A Comprehensive Survey , 2014, Proceedings of the IEEE.

[21]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[22]  Fei Tao,et al.  Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree Comparison , 2018, IEEE Access.

[23]  Klaus-Dieter Thoben,et al.  "Industrie 4.0" and Smart Manufacturing - A Review of Research Issues and Application Examples , 2017, Int. J. Autom. Technol..

[24]  Dong Yu,et al.  Deep Learning and Its Applications to Signal and Information Processing [Exploratory DSP] , 2011, IEEE Signal Processing Magazine.

[25]  Laurence T. Yang,et al.  A Tensor-Train Deep Computation Model for Industry Informatics Big Data Feature Learning , 2018, IEEE Transactions on Industrial Informatics.

[26]  Nada Golmie,et al.  A Survey on Industrial Internet of Things: A Cyber-Physical Systems Perspective , 2018, IEEE Access.

[27]  Xinwen Fu,et al.  A Survey on Big Data Market: Pricing, Trading and Protection , 2018, IEEE Access.

[28]  Josu Bilbao,et al.  Fog computing based efficient IoT scheme for the Industry 4.0 , 2017, 2017 IEEE International Workshop of Electronics, Control, Measurement, Signals and their Application to Mechatronics (ECMSM).

[29]  Arquimedes Canedo,et al.  Industrial IoT lifecycle via digital twins , 2016, 2016 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[30]  Stefan Boschert,et al.  Digital Twin—The Simulation Aspect , 2016 .

[31]  Chao Gao,et al.  Security Vulnerabilities of Internet of Things: A Case Study of the Smart Plug System , 2017, IEEE Internet of Things Journal.

[32]  Jaeho Kim,et al.  M2M Service Platforms: Survey, Issues, and Enabling Technologies , 2014, IEEE Communications Surveys & Tutorials.

[33]  Dong Yu,et al.  Deep Learning and Its Applications to Signal and Information Processing , 2011 .

[34]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[35]  Ying Tan,et al.  Generating Adversarial Malware Examples for Black-Box Attacks Based on GAN , 2017, DMBD.

[36]  Guangwen Yang,et al.  F-CNN: An FPGA-based framework for training Convolutional Neural Networks , 2016, 2016 IEEE 27th International Conference on Application-specific Systems, Architectures and Processors (ASAP).

[37]  Xun Xu,et al.  From cloud computing to cloud manufacturing , 2012 .

[38]  Morteza Ghobakhloo,et al.  The future of manufacturing industry: a strategic roadmap toward Industry 4.0 , 2018, Journal of Manufacturing Technology Management.

[39]  Navrati Saxena,et al.  Next Generation 5G Wireless Networks: A Comprehensive Survey , 2016, IEEE Communications Surveys & Tutorials.

[40]  Zachary Chase Lipton The mythos of model interpretability , 2016, ACM Queue.

[41]  Weixian Liao,et al.  Machine Learning for Security and the Internet of Things: The Good, the Bad, and the Ugly , 2019, IEEE Access.

[42]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[43]  Nada Golmie,et al.  Modeling and Performance Assessment of Dynamic Rate Adaptation for M2M Communications , 2020, IEEE Transactions on Network Science and Engineering.

[44]  Song Han,et al.  Learning both Weights and Connections for Efficient Neural Network , 2015, NIPS.

[45]  Stephen Hailes,et al.  Security of smart manufacturing systems , 2018 .

[46]  Antonio Liotta,et al.  Big IoT data mining for real-time energy disaggregation in buildings , 2017, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[47]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[48]  Wei Yu,et al.  A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends , 2018, IEEE Access.