Machine Learning in the Internet of Things for Industry 4.0

Number of IoT devices is constantly increasing which results in greater complexity of computations and high data velocity. One of the approach to process sensor data is dataflow programming. It enables the development of reactive software with short processing and rapid response times, especially when moved to the edge of the network. This is especially important in systems that utilize online machine learning algorithms to analyze ongoing processes such as those observed in Industry 4.0. In this paper, we show that organization of such systems depends on the entire processing stack, from the hardware layer all the way to the software layer, as well as on the required response times of the IoT system. We propose a flow processing stack for such systems along with the organizational machine learning architectural patterns that enable the possibility to spread the learning and inferencing on the edge and the cloud. In the paper, we analyse what latency is introduced by communication technologies used in the IoT for cloud connectivity and how they influence the response times of the system. Finally, we are providing recommendations which machine learning patterns should be used in the IoT systems depending on the application type.

[1]  Robert Brzoza-Woch,et al.  Flow-Based Programming for IoT Leveraging Fog Computing , 2017, 2017 IEEE 26th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE).

[2]  Robert Brzoza-Woch,et al.  Power aware MOM for telemetry-oriented applications using GPRS-enabled embedded devices - levee monitoring use case , 2014, 2014 Federated Conference on Computer Science and Information Systems.

[3]  Edward A. Lee.  Cyber Physical Systems: Design Challenges , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[4]  Michael Blackstock,et al.  IoT mashups with the WoTKit , 2012, 2012 3rd IEEE International Conference on the Internet of Things.

[5]  Vinod Vokkarane,et al.  A New Deep Learning-Based Food Recognition System for Dietary Assessment on An Edge Computing Service Infrastructure , 2018, IEEE Transactions on Services Computing.

[6]  Bartosz Balis,et al.  Holistic approach to management of IT infrastructure for environmental monitoring and decision support systems with urgent computing capabilities , 2018, Future Gener. Comput. Syst..

[7]  Prateek Jain,et al.  ProtoNN: Compressed and Accurate kNN for Resource-scarce Devices , 2017, ICML.

[8]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[9]  Heiko Wersing,et al.  Incremental on-line learning: A review and comparison of state of the art algorithms , 2018, Neurocomputing.

[10]  Mohsen Guizani,et al.  Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications , 2015, IEEE Communications Surveys & Tutorials.

[11]  Robert Brzoza-Woch,et al.  Enabling Machine Learning on Resource Constrained Devices by Source Code Generation of the Learned Models , 2018, ICCS.

[12]  Andreas Mitschele-Thiel,et al.  Latency Critical IoT Applications in 5G: Perspective on the Design of Radio Interface and Network Architecture , 2017, IEEE Communications Magazine.

[13]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[14]  Nicholas D. Lane,et al.  Demo: Accelerated Deep Learning Inference for Embedded and Wearable Devices using DeepX , 2016, MobiSys '16 Companion.

[15]  David Blaauw,et al.  14.7 A 288µW programmable deep-learning processor with 270KB on-chip weight storage using non-uniform memory hierarchy for mobile intelligence , 2017, 2017 IEEE International Solid-State Circuits Conference (ISSCC).

[16]  Christian Bauckhage,et al.  Malware Detection on Mobile Devices Using Distributed Machine Learning , 2010, 2010 20th International Conference on Pattern Recognition.

[17]  Josu Bilbao,et al.  Fog computing based efficient IoT scheme for the Industry 4.0 , 2017, 2017 IEEE International Workshop of Electronics, Control, Measurement, Signals and their Application to Mechatronics (ECMSM).

[18]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[19]  James Lam,et al.  An Improved Incremental Learning Approach for KPI Prognosis of Dynamic Fuel Cell System , 2016, IEEE Transactions on Cybernetics.

[20]  Lawrence D. Jackel,et al.  Fast Incremental Learning for Off-Road Robot Navigation , 2016, ArXiv.

[21]  Boris Otto,et al.  Design Principles for Industrie 4.0 Scenarios , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[22]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[23]  Tuyen X. Tran,et al.  Mobile Edge Computing : Recent Efforts and Five Key Research Directions , 2017 .

[24]  Qun Li,et al.  A Survey of Fog Computing: Concepts, Applications and Issues , 2015, Mobidata@MobiHoc.

[25]  R. S. Ponmagal,et al.  Integration of Wireless Sensor Network with Cloud , 2010, 2010 International Conference on Recent Trends in Information, Telecommunication and Computing.

[26]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[27]  Hadi Esmaeilzadeh,et al.  Bit Fusion: Bit-Level Dynamically Composable Architecture for Accelerating Deep Neural Network , 2017, 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA).

[28]  Gregory Ditzler,et al.  Learning in Nonstationary Environments: A Survey , 2015, IEEE Computational Intelligence Magazine.

[29]  Robert Brzoza-Woch,et al.  FPGA-Based Web Services -- Infinite Potential or a Road to Nowhere? , 2016, IEEE Internet Computing.

[30]  Malte Brettel,et al.  How Virtualization, Decentralization and Network Building Change the Manufacturing Landscape: An Industry 4.0 Perspective , 2014 .

[31]  Deepak Choudhary,et al.  Internet of things: A survey on enabling technologies, application and standardization , 2018 .

[32]  Saurabh Goyal,et al.  Resource-efficient Machine Learning in 2 KB RAM for the Internet of Things , 2017, ICML.

[33]  Thomas Olzak,et al.  What is virtualization , 2009 .