Smart Industrial IoT Monitoring and Control System Based on UAV and Cloud Computing Applied to a Concrete Plant

Unmanned aerial vehicles (UAVs) are now considered one of the best remote sensing techniques for gathering data over large areas. They are now being used in the industry sector as sensing tools for proactively solving or preventing many issues, besides quantifying production and helping to make decisions. UAVs are a highly consistent technological platform for efficient and cost-effective data collection and event monitoring. The industrial Internet of things (IIoT) sends data from systems that monitor and control the physical world to data processing systems that cloud computing has shown to be important tools for meeting processing requirements. In fog computing, the IoT gateway links different objects to the internet. It can operate as a joint interface for different networks and support different communication protocols. A great deal of effort has been put into developing UAVs and multi-UAV systems. This paper introduces a smart IIoT monitoring and control system based on an unmanned aerial vehicle that uses cloud computing services and exploits fog computing as the bridge between IIoT layers. Its novelty lies in the fact that the UAV is automatically integrated into an industrial control system through an IoT gateway platform, while UAV photos are systematically and instantly computed and analyzed in the cloud. Visual supervision of the plant by drones and cloud services is integrated in real-time into the control loop of the industrial control system. As a proof of concept, the platform was used in a case study in an industrial concrete plant. The results obtained clearly illustrate the feasibility of the proposed platform in providing a reliable and efficient system for UAV remote control to improve product quality and reduce waste. For this, we studied the communication latency between the different IIoT layers in different IoT gateways.

[1]  Ashish Manohar,et al.  Drone based image processing through feature extraction , 2017, 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT).

[2]  Robert Ryan McCune Node.js Paradigms and Benchmarks , 2011 .

[3]  Geoffrey Fox,et al.  Real-Time Object Detection for Unmanned Aerial Vehicles based on Cloud-based Convolutional Neural Networks , 2015 .

[4]  Stefan Forsström,et al.  A performance and cost evaluation of combining OPC-UA and Microsoft Azure IoT Hub into an industrial Internet-of-Things system , 2017, 2017 Global Internet of Things Summit (GIoTS).

[5]  Luis Enrique Sucar,et al.  UAV technology and machine learning techniques applied to the yield improvement in precision agriculture , 2017, 2017 IEEE Mexican Humanitarian Technology Conference (MHTC).

[6]  Dirk Timmermann,et al.  Algorithmic approach to estimate variant software latencies for latency-sensitive networking , 2016, 2016 IEEE 7th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[7]  Alfredo Toriz Palacios,et al.  New Applications of 3D SLAM on Risk Management Using Unmanned Aerial Vehicles in the Construction Industry , 2018, Drones - Applications.

[8]  Geoffrey C. Fox,et al.  Real-Time, Cloud-Based Object Detection for Unmanned Aerial Vehicles , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[9]  Tiago M. Fernández-Caramés,et al.  A Practical Evaluation of a High-Security Energy-Efficient Gateway for IoT Fog Computing Applications , 2017, Sensors.

[10]  Lakmal Seneviratne,et al.  Autonomous Wireless Self-Charging for Multi-Rotor Unmanned Aerial Vehicles , 2017 .

[11]  Alina Gîrbea,et al.  Design and Implementation of a Service-Oriented Architecture for the Optimization of Industrial Applications , 2014, IEEE Transactions on Industrial Informatics.

[12]  Jim Kurose,et al.  Computer Networking: A Top-Down Approach , 1999 .

[13]  Ou Ma,et al.  Collaboration of Drone and Internet of Public Safety Things in Smart Cities: An Overview of QoS and Network Performance Optimization , 2019, Drones.

[14]  Athanasios V. Vasilakos,et al.  Cloud robotics: Current status and open issues , 2016, IEEE Access.

[15]  Mihui Kim,et al.  Development of Cloud-Based UAV Monitoring and Management System , 2016, Sensors.

[16]  John R. Smith,et al.  Distributed learning of deep feature embeddings for visual recognition tasks , 2017, IBM J. Res. Dev..

[17]  Aníbal Ollero,et al.  Extracting Objects for Aerial Manipulation on UAVs Using Low Cost Stereo Sensors , 2016, Sensors.

[18]  Dietmar P. F. Möller,et al.  Guide to Computing Fundamentals in Cyber-Physical Systems , 2016, Computer Communications and Networks.

[19]  Johan J. Lukkien,et al.  Analysis of Ethernet-switch traffic shapers for in-vehicle networking applications , 2015, 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[20]  Gorka Sorrosal,et al.  Automatic system for overhead power line inspection using an Unmanned Aerial Vehicle — RELIFO project , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[21]  J. Dafni Rose,et al.  A case analysis of node.js I/O performance under Linux environment in various storage media , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[22]  Mohsen Guizani,et al.  Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges , 2018, IEEE Access.

[23]  Alasdair Gilchrist Introducing Industry 4.0 , 2016 .

[24]  Emiliano Sisinni,et al.  Impact of Quality of Service on Cloud Based Industrial IoT Applications with OPC UA , 2018 .

[25]  Emiliano Sisinni,et al.  Evaluation of communication latency in industrial IoT applications , 2017, 2017 IEEE International Workshop on Measurement and Networking (M&N).

[26]  Song Han,et al.  Industrial Internet of Things: Challenges, Opportunities, and Directions , 2018, IEEE Transactions on Industrial Informatics.

[27]  Simon Bøgh,et al.  A Skill-based Robot Co-worker for Industrial Maintenance Tasks , 2017 .

[28]  D. Kutscher,et al.  OPC UA TSNA new Solution for Industrial Communication , 2018 .

[29]  Samer Jaloudi,et al.  Communication Protocols of an Industrial Internet of Things Environment: A Comparative Study , 2019, Future Internet.

[30]  Zilvinas Nakutis,et al.  Round-Trip Delay Estimation in OPC UA Server-Client Communication Channel , 2016 .

[31]  Ferdinando Chiacchio,et al.  To OPC UA Client OPC UA Server Server Application OPC UA Communication Stack OPC UA Server API From OPC UA Client From OPC UA Client To OPC UA Client Request Message OPC , 2013 .

[32]  Daniel Rosner,et al.  ZigBee based wireless modbus aggregator for intelligent industrial facilities , 2017, 2017 25th Telecommunication Forum (TELFOR).

[33]  Thomas Lagkas,et al.  UAV IoT Framework Views and Challenges: Towards Protecting Drones as “Things” , 2018, Sensors.

[34]  Dimitrios Tzovaras,et al.  Simulating Fog and Edge Computing Scenarios: An Overview and Research Challenges , 2019, Future Internet.

[35]  Lars Karlsson,et al.  Autonomous Transport Vehicles: Where We Are and What Is Missing , 2015, IEEE Robotics & Automation Magazine.

[36]  Tiago M. Fernández-Caramés,et al.  A Review on Human-Centered IoT-Connected Smart Labels for the Industry 4.0 , 2018, IEEE Access.

[37]  D. Marpe,et al.  The H.264/MPEG4 advanced video coding standard and its applications , 2006, IEEE Communications Magazine.

[38]  Lander Usategui San Juan,et al.  Time-Sensitive Networking for robotics , 2018, ArXiv.

[39]  Devendra Patil,et al.  Eye in the Sky: Real-Time Drone Surveillance System (DSS) for Violent Individuals Identification Using ScatterNet Hybrid Deep Learning Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[40]  Bo Hu,et al.  A Vision of IoT: Applications, Challenges, and Opportunities With China Perspective , 2014, IEEE Internet of Things Journal.

[41]  Daniel Cremers,et al.  Accurate Figure Flying with a Quadrocopter Using Onboard Visual and Inertial Sensing , 2012 .

[42]  Sung-Han Sim,et al.  Concrete Crack Identification Using a UAV Incorporating Hybrid Image Processing , 2017, Sensors.

[43]  Sherali Zeadally,et al.  Deploying Fog Computing in Industrial Internet of Things and Industry 4.0 , 2018, IEEE Transactions on Industrial Informatics.

[44]  Sergei Astapov,et al.  Data to decision: pushing situational information needs to the edge of the network , 2015, 2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision.

[45]  Francisco Javier Ferrández Pastor,et al.  Developing Ubiquitous Sensor Network Platform Using Internet of Things: Application in Precision Agriculture , 2016, Sensors.

[46]  Walid Saad,et al.  Resource Allocation for Machine-to-Machine Communications with Unmanned Aerial Vehicles , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).

[47]  J. R. Llata,et al.  Working Together: A Review on Safe Human-Robot Collaboration in Industrial Environments , 2017, IEEE Access.

[48]  Ghenadie Corotinschi,et al.  Enabling IoT connectivity for Modbus networks by using IoT edge gateways , 2018, 2018 International Conference on Development and Application Systems (DAS).

[49]  John R. Smith,et al.  Massive-scale learning of image and video semantic concepts , 2015, IBM J. Res. Dev..

[50]  Lei Shu,et al.  Smart Factory of Industry 4.0: Key Technologies, Application Case, and Challenges , 2018, IEEE Access.