Activity recognition in manual manufacturing: Detecting screwing processes from sensor data

Abstract Knowledge about the duration of manufacturing processes and operation times is essential for production planning and control. But data acquisition is often difficult and especially challenging if production requires manual activities. This paper presents different data analysis and machine learning approaches to detect manual manufacturing processes from sensor data. As human activity recognition approaches are not necessarily applicable in industrial environments, all sensors are attached to tools, in this case screwdrivers. A dataset covering different tool movements, sensor types and mounting options is created and analyzed. The results are evaluated in terms of feasibility of the approach.

[1]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[2]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[3]  Thomas Bauernhansl,et al.  Sensor-driven Analysis of Manual Assembly Systems , 2018 .

[4]  Cagatay Catal,et al.  On the use of ensemble of classifiers for accelerometer-based activity recognition , 2015, Appl. Soft Comput..

[5]  Pedro M. Domingos.  A few useful things to know about machine learning , 2012, Commun. ACM.

[6]  Paul Lukowicz,et al.  Wearable Activity Tracking in Car Manufacturing , 2008, IEEE Pervasive Computing.

[7]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[8]  Héctor Pomares,et al.  Window Size Impact in Human Activity Recognition , 2014, Sensors.

[9]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[10]  Evangelos Spiliotis,et al.  Statistical and Machine Learning forecasting methods: Concerns and ways forward , 2018, PloS one.

[11]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[12]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[13]  Thomas Plötz,et al.  Using unlabeled data in a sparse-coding framework for human activity recognition , 2014, Pervasive Mob. Comput..

[14]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[15]  Jose Antonio Diego-Mas,et al.  Using Kinect™ sensor in observational methods for assessing postures at work. , 2014, Applied ergonomics.

[16]  Lorenzo Gori,et al.  Remote detection of rotating machinery with a portable atomic magnetometer. , 2017, Applied optics.

[17]  J. D. Janssen,et al.  A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity , 1997, IEEE Transactions on Biomedical Engineering.

[18]  Tim Dallas,et al.  Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer , 2014, IEEE Transactions on Biomedical Engineering.

[19]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.