A Smart Safety Helmet using IMU and EEG sensors for worker fatigue detection

It is known that head gesture and brain activity can reflect some human behaviors related to a risk of accident when using machine-tools. The research presented in this paper aims at reducing the risk of injury and thus increase worker safety. Instead of using camera, this paper presents a Smart Safety Helmet (SSH) in order to track the head gestures and the brain activity of the worker to recognize anomalous behavior. Information extracted from SSH is used for computing risk of an accident (a safety level) for preventing and reducing injuries or accidents. The SSH system is an inexpensive, non-intrusive, non-invasive, and non-vision-based system, which consists of an Inertial Measurement Unit (IMU) and dry EEG electrodes. A haptic device, such as vibrotactile motor, is integrated to the helmet in order to alert the operator when computed risk level (fatigue, high stress or error) reaches a threshold. Once the risk level of accident breaks the threshold, a signal will be sent wirelessly to stop the relevant machine tool or process.

[1]  Tzyy-Ping Jung,et al.  EEG-based drowsiness estimation for safety driving using independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[2]  Eric M. Foxlin.  Head tracking relative to a moving vehicle or simulator platform using differential inertial sensors , 2000, Defense, Security, and Sensing.

[3]  Martin J.-D. Otis,et al.  Toward an augmented shoe for preventing falls related to physical conditions of the soil , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[4]  Jyh-Yeong Chang,et al.  Gaming control using a wearable and wireless EEG-based brain-computer interface device with novel dry foam-based sensors , 2012, Journal of NeuroEngineering and Rehabilitation.

[5]  Kamiar Aminian,et al.  Measurement of stand-sit and sit-stand transitions using a miniature gyroscope and its application in fall risk evaluation in the elderly , 2002, IEEE Transactions on Biomedical Engineering.

[6]  A. Belyavin,et al.  Changes in electrical activity of the brain with vigilance. , 1987, Electroencephalography and clinical neurophysiology.

[7]  Wilhelm Stork,et al.  Smartphone pedestrian navigation by foot-IMU sensor fusion , 2012, 2012 Ubiquitous Positioning, Indoor Navigation, and Location Based Service (UPINLBS).

[8]  Yeh-Liang Hsu,et al.  A Review of Accelerometry-Based Wearable Motion Detectors for Physical Activity Monitoring , 2010, Sensors.

[9]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[10]  Richard Barnett,et al.  Fatigue , 1896, The Lancet.

[11]  Bao-Liang Lu,et al.  Vigilance Estimation Based on EEG Signals , 2007 .

[12]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[13]  Daniel P. Siewiorek,et al.  Design of a wearable tactile display , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[14]  Eric Foxlin,et al.  Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[15]  Kiseon Kim,et al.  Review of Wireless Brain-Computer Interface Systems , 2013 .

[16]  Robert W. Lindeman,et al.  Wearable vibrotactile systems for virtual contact and information display , 2006, Virtual Reality.

[17]  Eric Foxlin,et al.  Improved Pedestrian Navigation Based on Drift-Reduced MEMS IMU Chip , 2010 .

[18]  Lei Jing,et al.  Analysis and Selection of Features for Gesture Recognition Based on a Micro Wearable Device , 2012 .

[19]  G. ÓLaighin,et al.  Direct measurement of human movement by accelerometry. , 2008, Medical engineering & physics.

[20]  Hikaru Inooka,et al.  A Method for Gait Analysis in a Daily Living Environment by Body-Mounted Instruments , 2001 .

[21]  Weihua Sheng,et al.  Human daily activity recognition in robot-assisted living using multi-sensor fusion , 2009, 2009 IEEE International Conference on Robotics and Automation.

[22]  Klas Ihme,et al.  A Dry EEG-System for Scientific Research and Brain–Computer Interfaces , 2010, Front. Neurosci..

[23]  Feng Wan,et al.  Objective evaluation of fatigue by EEG spectral analysis in steady-state visual evoked potential-based brain-computer interfaces , 2014, Biomedical engineering online.

[24]  Henrik I. Christensen,et al.  Wiimote robot control using human motion models , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Mohammed Khider,et al.  A high precision reference data set for pedestrian navigation using foot-mounted inertial sensors , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[26]  Michael Harrington,et al.  Miniature six-DOF inertial system for tracking HMDs , 1998, Defense, Security, and Sensing.

[27]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[28]  P. Robertson,et al.  Unscented Kalman filter and Magnetic Angular Rate Update (MARU) for an improved Pedestrian Dead-Reckoning , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[29]  Joseph A. Paradiso,et al.  Gait Analysis Using a Shoe-Integrated Wireless Sensor System , 2008, IEEE Transactions on Information Technology in Biomedicine.