Smart Helmet 5.0 for Industrial Internet of Things Using Artificial Intelligence

Information and communication technologies (ICTs) have contributed to advances in Occupational Health and Safety, improving the security of workers. The use of Personal Protective Equipment (PPE) based on ICTs reduces the risk of accidents in the workplace, thanks to the capacity of the equipment to make decisions on the basis of environmental factors. Paradigms such as the Industrial Internet of Things (IIoT) and Artificial Intelligence (AI) make it possible to generate PPE models feasibly and create devices with more advanced characteristics such as monitoring, sensing the environment and risk detection between others. The working environment is monitored continuously by these models and they notify the employees and their supervisors of any anomalies and threats. This paper presents a smart helmet prototype that monitors the conditions in the workers’ environment and performs a near real-time evaluation of risks. The data collected by sensors is sent to an AI-driven platform for analysis. The training dataset consisted of 11,755 samples and 12 different scenarios. As part of this research, a comparative study of the state-of-the-art models of supervised learning is carried out. Moreover, the use of a Deep Convolutional Neural Network (ConvNet/CNN) is proposed for the detection of possible occupational risks. The data are processed to make them suitable for the CNN and the results are compared against a Static Neural Network (NN), Naive Bayes Classifier (NB) and Support Vector Machine (SVM), where the CNN had an accuracy of 92.05% in cross-validation.

[1]  P. Hasle,et al.  A review of the literature on preventive occupational health and safety activities in small enterprises. , 2006, Industrial health.

[2]  G. ÓLaighin,et al.  Direct measurement of human movement by accelerometry. , 2008, Medical engineering & physics.

[3]  Hikaru Inooka,et al.  A Method for Gait Analysis in a Daily Living Environment by Body-Mounted Instruments , 2001 .

[4]  Philippe Cardou,et al.  A Smart Safety Helmet using IMU and EEG sensors for worker fatigue detection , 2014, 2014 IEEE International Symposium on Robotic and Sensors Environments (ROSE) Proceedings.

[5]  Xu Xiaoli,et al.  Design of Intelligent Internet of Things for Equipment Maintenance , 2011, 2011 Fourth International Conference on Intelligent Computation Technology and Automation.

[6]  Weihua Sheng,et al.  Human daily activity recognition in robot-assisted living using multi-sensor fusion , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  G. D'Agostini,et al.  A Multidimensional unfolding method based on Bayes' theorem , 1995 .

[8]  Sunghun Kim,et al.  Safety Helmet Wearing Management System for Construction Workers Using Three-Axis Accelerometer Sensor , 2018, Applied Sciences.

[9]  Marie-Odile Cordier,et al.  Monitoring and Alarm Interpretation in Industrial Environments , 1998, AI Commun..

[10]  Rashid Rashidzadeh,et al.  Wi-Fi based indoor location positioning employing random forest classifier , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[11]  John D. Kelleher,et al.  Fundamentals of Machine Learning for Predictive Data Analytics: Algorithms, Worked Examples, and Case Studies , 2015 .

[12]  Aleck Ian Glendon,et al.  Safety climate factors, group differences and safety behaviour in road construction , 2001 .

[13]  Hal R. Varian,et al.  Artificial Intelligence, Economics, and Industrial Organization , 2018 .

[14]  Feng Wan,et al.  Objective evaluation of fatigue by EEG spectral analysis in steady-state visual evoked potential-based brain-computer interfaces , 2014, Biomedical engineering online.

[15]  Carlos T. Formoso,et al.  Identification, analysis and dissemination of information on near misses: A case study in the construction industry , 2010 .

[16]  Weisheng Lu,et al.  Towards the “third wave”: An SCO-enabled occupational health and safety management system for construction , 2019, Safety Science.

[17]  Seokho Chi,et al.  Analyses of systems theory for construction accident prevention with specific reference to OSHA accident reports , 2013 .

[18]  Juan M. Corchado,et al.  Non-linear adaptive closed-loop control system for improved efficiency in IoT-blockchain management , 2019, Inf. Fusion.

[19]  Tariq S. Abdelhamid,et al.  Identifying Root Causes of Construction Accidents , 2001 .

[20]  Juan M. Corchado,et al.  Approximate Gaussian conjugacy: parametric recursive filtering under nonlinearity, multimodality, uncertainty, and constraint, and beyond , 2017, Frontiers of Information Technology & Electronic Engineering.

[21]  D. Fang,et al.  Why operatives engage in unsafe work behavior: Investigating factors on construction sites , 2008 .

[22]  Jingdao Chen,et al.  A framework for real-time pro-active safety assistance for mobile crane lifting operations , 2016 .

[23]  Juan M. Corchado,et al.  Tendencies of Technologies and Platforms in Smart Cities: A State-of-the-Art Review , 2018, Wirel. Commun. Mob. Comput..

[24]  Dima Damen,et al.  Cognitive Learning, Monitoring and Assistance of Industrial Workflows Using Egocentric Sensor Networks , 2015, PloS one.

[25]  Mongkol Ekpanyapong,et al.  Helmet violation processing using deep learning , 2018, 2018 International Workshop on Advanced Image Technology (IWAIT).

[26]  Sreenithy Chandran,et al.  Konnect: An Internet of Things(IoT) based smart helmet for accident detection and notification , 2016, 2016 IEEE Annual India Conference (INDICON).

[27]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[28]  Bao-Liang Lu,et al.  Vigilance Estimation Based on EEG Signals , 2007 .

[29]  Mario Chica-Olmo,et al.  An assessment of the effectiveness of a random forest classifier for land-cover classification , 2012 .

[30]  Yannick Chevalier,et al.  A High Level Protocol Specification Language for Industrial Security-Sensitive Protocols , 2004 .

[31]  Konstantinos C. Gryllias,et al.  A Support Vector Machine approach based on physical model training for rolling element bearing fault detection in industrial environments , 2012, Eng. Appl. Artif. Intell..

[32]  M. Jasmine Pemeena Priyadarsini,et al.  Safety helmet with alcohol detection and theft control for bikers , 2017, 2017 International Conference on Intelligent Sustainable Systems (ICISS).

[33]  Linu Shine,et al.  Automated detection of helmet on motorcyclists from traffic surveillance videos: a comparative analysis using hand-crafted features and CNN , 2020, Multimedia Tools and Applications.

[34]  João Barata,et al.  The Viable Smart Product Model: Designing Products that Undergo Disruptive Transformations , 2019, Cybern. Syst..

[35]  Tanmoy Maity,et al.  Rescue and protection system for underground mine workers based on Zigbee , 2012 .

[36]  S. Kumar,et al.  Prevalence and pattern of occupational injuries at workplace among welders in coastal south India , 2014, Indian Journal of Occupational and Environmental Medicine.

[37]  Robert W. Lindeman,et al.  Wearable vibrotactile systems for virtual contact and information display , 2006, Virtual Reality.

[38]  Haobin Jiang,et al.  A comparative study on machine learning based algorithms for prediction of motorcycle crash severity , 2019, PloS one.

[39]  Juan M. Corchado,et al.  Smart Contract for Monitoring and Control of Logistics Activities: Pharmaceutical Utilities Case Study , 2018, SOCO-CISIS-ICEUTE.

[40]  Daniel Podgórski,et al.  Towards a conceptual framework of OSH risk management in smart working environments based on smart PPE, ambient intelligence and the Internet of Things technologies , 2017, International journal of occupational safety and ergonomics : JOSE.

[41]  James E. Diekmann,et al.  Risk analysis: lessons from artificial intelligence , 1992 .

[42]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.

[43]  Chun-Wei Yang,et al.  Applications of artificial intelligence in intelligent manufacturing: a review , 2017, Frontiers of Information Technology & Electronic Engineering.

[44]  Jay Lee,et al.  Industrial Artificial Intelligence for industry 4.0-based manufacturing systems , 2018, Manufacturing Letters.

[45]  Lei Jing,et al.  Analysis and Selection of Features for Gesture Recognition Based on a Micro Wearable Device , 2012 .

[46]  Thomas J. Watson,et al.  An empirical study of the naive Bayes classifier , 2001 .

[47]  Danièle Champoux,et al.  Occupational health and safety management in small size enterprises: an overview of the situation and avenues for intervention and research , 2003 .

[48]  Igor Bisio,et al.  Mobile Smart Helmet for Brain Stroke Early Detection through Neural Network-Based Signals Analysis , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[49]  Hiromitsu Kumamoto,et al.  Designing for reliability and safety control , 1985 .

[50]  Eirik Albrechtsen,et al.  The application and benefits of job safety analysis , 2019, Safety Science.

[51]  P. Robertson,et al.  Unscented Kalman filter and Magnetic Angular Rate Update (MARU) for an improved Pedestrian Dead-Reckoning , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[52]  Nina Korlina Madzhi,et al.  Smart helmet with sensors for accident prevention , 2013, 2013 International Conference on Electrical, Electronics and System Engineering (ICEESE).

[53]  Mohammad Khalilia,et al.  Predicting disease risks from highly imbalanced data using random forest , 2011, BMC Medical Informatics Decis. Mak..

[54]  Rayford B. Vaughn,et al.  An empirical study of industrial security-engineering practices , 2002, J. Syst. Softw..

[55]  James Brown,et al.  Exploring the Design of Pay-Per-Use Objects in the Construction Domain , 2008, EuroSSC.

[56]  Joaquín B. Ordieres Meré,et al.  Healthy Operator 4.0: A Human Cyber–Physical System Architecture for Smart Workplaces , 2020, Sensors.

[57]  Juan M. Corchado,et al.  GreenVMAS: Virtual Organization Based Platform for Heating Greenhouses Using Waste Energy from Power Plants , 2018, Sensors.

[58]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[59]  Tao Cheng,et al.  Real-time resource location data collection and visualization technology for construction safety and activity monitoring applications , 2013 .

[60]  S. Saravana Perumaal,et al.  Deep learning‐based helmet wear analysis of a motorcycle rider for intelligent surveillance system , 2019, IET Intelligent Transport Systems.

[61]  Aboul Ella Hassanien,et al.  A random forest classifier for lymph diseases , 2014, Comput. Methods Programs Biomed..

[62]  Martin J.-D. Otis,et al.  Toward an augmented shoe for preventing falls related to physical conditions of the soil , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[63]  Beatriz Fernández-Muñiz,et al.  Safety climate in OHSAS 18001-certified organisations: antecedents and consequences of safety behaviour. , 2012, Accident; analysis and prevention.

[64]  Lise Granerud Social responsibility as an intermediary for health and safety in small firms , 2011 .

[65]  Oishila Bandyopadhyay,et al.  Automated Helmet Detection for Multiple Motorcycle Riders using CNN , 2019, 2019 IEEE Conference on Information and Communication Technology.

[66]  Y. Han,et al.  Condition Monitoring Techniques for Electrical Equipment: A Literature Survey , 2002, IEEE Power Engineering Review.

[67]  Amirfarrokh Iranitalab,et al.  Comparison of four statistical and machine learning methods for crash severity prediction. , 2017, Accident; analysis and prevention.

[68]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[69]  A. Mohamed Syed Ali Helmet Deduction Using Image Processing , 2018 .

[70]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .