A Case Driven Study of the Use of Time Series Classification for Flexibility in Industry 4.0

With the Industry 4.0 paradigm comes the convergence of the Internet Technologies and Operational Technologies, and concepts, such as Industrial Internet of Things (IIoT), cloud manufacturing, Cyber-Physical Systems (CPS), and so on. These concepts bring industries into the big data era and allow for them to have access to potentially useful information in order to optimise the Overall Equipment Effectiveness (OEE); however, most European industries still rely on the Computer-Integrated Manufacturing (CIM) model, where the production systems run as independent systems (i.e., without any communication with the upper levels). Those production systems are controlled by a Programmable Logic Controller, in which a static and rigid program is implemented. This program is static and rigid in a sense that the programmed routines cannot evolve over the time unless a human modifies it. However, to go further in terms of flexibility, we are convinced that it requires moving away from the aforementioned old-fashioned and rigid automation to a ML-based automation, i.e., where the control itself is based on the decisions that were taken by ML algorithms. In order to verify this, we applied a time series classification method on a scale model of a factory using real industrial controllers, and widened the variety of parts the production line has to treat. This study shows that satisfactory results can be obtained only at the expense of the human expertise (i.e., in the industrial process and in the ML process).

[1]  Jason Lines,et al.  Time series classification with ensembles of elastic distance measures , 2015, Data Mining and Knowledge Discovery.

[2]  Guanghua Xu,et al.  Health indicator construction of machinery based on end-to-end trainable convolution recurrent neural networks , 2020 .

[3]  Nuno Constantino Castro,et al.  Time Series Data Mining , 2009, Encyclopedia of Database Systems.

[4]  Sapna Tyagi,et al.  A conceptual framework for IoT-based healthcare system using cloud computing , 2016, 2016 6th International Conference - Cloud System and Big Data Engineering (Confluence).

[5]  H. Vincent Poor,et al.  Machine Learning Methods for Attack Detection in the Smart Grid , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Miao Yun,et al.  Research on the architecture and key technology of Internet of Things (IoT) applied on smart grid , 2010, 2010 International Conference on Advances in Energy Engineering.

[7]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[8]  Jason Lines,et al.  A shapelet transform for time series classification , 2012, KDD.

[9]  Ke Shi,et al.  RETRACTED: A Self-learning Classification Framework for Industrial Time Series Streams , 2019 .

[10]  Vasja Roblek,et al.  A Complex View of Industry 4.0 , 2016 .

[11]  Matthew Middlehurst,et al.  Scalable Dictionary Classifiers for Time Series Classification , 2019, IDEAL.

[12]  Alasdair Gilchrist.  Industry 4.0 , 2016, Apress.

[13]  Peng Wang,et al.  Long short-term memory for machine remaining life prediction , 2018, Journal of Manufacturing Systems.

[14]  José Barbosa,et al.  Low-Cost Industrial Controller based on the Raspberry Pi Platform , 2020, 2020 IEEE International Conference on Industrial Technology (ICIT).

[15]  M. A. Zaidan,et al.  Predicting atmospheric particle formation days by Bayesian classification of the time series features , 2018 .

[16]  Ateeq Ur Rehman,et al.  Deep Learning-Based Drivers Emotion Classification System in Time Series Data for Remote Applications , 2020, Remote. Sens..

[17]  Marco Antonelli,et al.  Fault detection and explanation through big data analysis on sensor streams , 2017, Expert Syst. Appl..

[18]  Fabio Martinelli,et al.  A time series classification approach to game bot detection , 2017, WIMS.

[19]  Bart Baesens,et al.  Time series for early churn detection: Using similarity based classification for dynamic networks , 2018, Expert Syst. Appl..

[20]  César Soto-Valero,et al.  A predictive model for analysing the starting pitchers’ performance using time series classification methods , 2017 .

[21]  In Lee,et al.  The Internet of Things (IoT): Applications, investments, and challenges for enterprises , 2015 .

[22]  Birgit Vogel-Heuser,et al.  Guest Editorial Industry 4.0-Prerequisites and Visions , 2016, IEEE Trans Autom. Sci. Eng..

[23]  Satish T. S. Bukkapatnam,et al.  The internet of things for smart manufacturing: A review , 2019, IISE Trans..

[24]  Patrick Schäfer.  The BOSS is concerned with time series classification in the presence of noise , 2014, Data Mining and Knowledge Discovery.

[25]  Xing Wang,et al.  Exact variable-length anomaly detection algorithm for univariate and multivariate time series , 2018, Data Mining and Knowledge Discovery.

[26]  Eamonn J. Keogh,et al.  Time series shapelets: a new primitive for data mining , 2009, KDD.

[27]  Weiming Shen,et al.  A sensor fusion and support vector machine based approach for recognition of complex machining conditions , 2018, J. Intell. Manuf..

[28]  Sergey Malinchik,et al.  SAX-VSM: Interpretable Time Series Classification Using SAX and Vector Space Model , 2013, 2013 IEEE 13th International Conference on Data Mining.

[29]  Peter Loos,et al.  Time Series Classification using Deep Learning for Process Planning: A Case from the Process Industry , 2017 .

[30]  José Barata,et al.  A Multiagent Based Control System Applied to an Educational Shop Floor , 2006, BASYS.

[31]  Jérémy Robert,et al.  Assessing the impact of attacks on OPC-UA applications in the Industry 4.0 era , 2019, 2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[32]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[33]  Yang Guo,et al.  A Hybrid Deep Representation Learning Model for Time Series Classification and Prediction , 2017, 2017 3rd International Conference on Big Data Computing and Communications (BIGCOM).

[34]  Wei Sun,et al.  Discharge Voltage Time Series Classification of Lithium-ion Cells Based on Deep Neural Networks , 2018, 2018 IEEE 4th International Conference on Computer and Communications (ICCC).

[35]  Hui Ding,et al.  Querying and mining of time series data: experimental comparison of representations and distance measures , 2008, Proc. VLDB Endow..

[36]  P. Siano,et al.  Iot-based smart cities: A survey , 2016, 2016 IEEE 16th International Conference on Environment and Electrical Engineering (EEEIC).

[37]  Muhammad Tariq,et al.  Secure and resilient demand side management engine using machine learning for IoT-enabled smart grid , 2020 .

[38]  Jason Lines,et al.  Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles , 2015, IEEE Transactions on Knowledge and Data Engineering.

[39]  Kang B. Lee,et al.  Smart Sensors and Standard-Based Interoperability in Smart Grids , 2017, IEEE Sensors Journal.

[40]  Fabio Martinelli,et al.  Driver and Path Detection through Time-Series Classification , 2018 .

[41]  Giovanna Martínez-Arellano,et al.  Tool wear classification using time series imaging and deep learning , 2019, The International Journal of Advanced Manufacturing Technology.

[42]  Didier Stricker,et al.  Visual Computing as a Key Enabling Technology for Industrie 4.0 and Industrial Internet , 2015, IEEE Computer Graphics and Applications.

[43]  Ulf Leser,et al.  Fast and Accurate Time Series Classification with WEASEL , 2017, CIKM.

[44]  N. Jazdi,et al.  Cyber physical systems in the context of Industry 4.0 , 2014, 2014 IEEE International Conference on Automation, Quality and Testing, Robotics.

[45]  Eamonn J. Keogh,et al.  Time Series Classification to Improve Poultry Welfare , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[46]  Gordana Gardasevic,et al.  CoAP protocol for Web-based monitoring in IoT healthcare applications , 2015, 2015 23rd Telecommunications Forum Telfor (TELFOR).

[47]  Kevin G. Montero Quispe,et al.  Human Activity Recognition Based on Symbolic Representation Algorithms for Inertial Sensors , 2018, Sensors.

[48]  Zhixiong Li,et al.  Prediction of surface roughness in extrusion-based additive manufacturing with machine learning , 2019, Robotics and Computer-Integrated Manufacturing.

[49]  D. Graciela Colome,et al.  Real-time multi-state classification of short-term voltage stability based on multivariate time series machine learning , 2019, International Journal of Electrical Power & Energy Systems.

[50]  Marc Chaumont,et al.  A CNN adapted to time series for the classification of Supernovae , 2019, Color Imaging: Displaying, Processing, Hardcopy, and Applications.

[51]  Dirk Müller,et al.  Application of selected supervised learning methods for time series classification in Building Automation and Control Systems , 2017 .

[52]  Patrick Schäfer,et al.  SFA: a symbolic fourier approximation and index for similarity search in high dimensional datasets , 2012, EDBT '12.

[53]  Fabien Autrel,et al.  Science Hackathons for Cyberphysical System Security Research: Putting CPS testbed platforms to good use , 2018, CPS-SPC@CCS.

[54]  Marc Rußwurm,et al.  Self-Attention for Raw Optical Satellite Time Series Classification , 2019, ArXiv.

[55]  Noureddine Zerhouni,et al.  Data-driven prognostic method based on Bayesian approaches for direct remaining useful life prediction , 2016, J. Intell. Manuf..

[56]  Jason Lines,et al.  HIVE-COTE: The Hierarchical Vote Collective of Transformation-Based Ensembles for Time Series Classification , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[57]  Jeonghan Hong,et al.  Multivariate time-series classification of sleep patterns using a hybrid deep learning architecture , 2017, 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom).

[58]  Nick S. Jones,et al.  Highly Comparative Feature-Based Time-Series Classification , 2014, IEEE Transactions on Knowledge and Data Engineering.

[59]  Andrew Kusiak,et al.  Data-driven smart manufacturing , 2018, Journal of Manufacturing Systems.

[60]  Yuan Li,et al.  Rotation-invariant similarity in time series using bag-of-patterns representation , 2012, Journal of Intelligent Information Systems.

[61]  Baidya Nath Saha,et al.  Bayesian Network Classifier with Efficient Statistical Time-Series Features for the Classification of Robot Execution Failures , 2016 .

[62]  Eamonn J. Keogh,et al.  The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances , 2016, Data Mining and Knowledge Discovery.

[63]  Daoyuan Li.  Transforming Time Series for Efficient and Accurate Classification , 2018 .