Blink and Wink Detection in a Real Working Environment

A simple and effective method of recognizing eye blinking in industrial conditions is presented. The developed method uses a camera built into safety glasses. The presented algorithm can be applied to recognize whether glasses are correctly put on – to check if employees use personal protective equipment. Recognition of open or closed eyes allows control by intentional winking. The algorithm uses only light sources present in the workplace and does not require infrared radiation (IR). The solution was tested on a set of 1797 eye photos recorded in a group of 10 participants. An analysis of the correctness of blink recognition and the correctness of the algorithm's operation in various lighting conditions was carried out. Experiments showed that the proposed algorithm met required project assumptions. The averaged results of blink recognition obtained using the developed method are: accuracy 96.5%, precision 93.8%, specificity 98.9% and sensitivity 84.9%. Additionally the algorithm is insensitive to changes in lighting and allows the use of one type of glasses for different employees.

[1]  P. Caffier,et al.  Experimental evaluation of eye-blink parameters as a drowsiness measure , 2003, European Journal of Applied Physiology.

[2]  Dariusz Sawicki,et al.  Blink and wink detection as a control tool in multimodal interaction , 2018, Multimedia Tools and Applications.

[3]  Margrit Betke,et al.  Communication via eye blinks - detection and duration analysis in real time , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  DaeHyun Ryu,et al.  Computer Control by Tracking Head Movements for the Disabled , 2006, ICCHP.

[5]  Peter M. Corcoran,et al.  Statistical models of appearance for eye tracking and eye-blink detection and measurement , 2008, IEEE Transactions on Consumer Electronics.

[6]  Jaswinder Singh,et al.  Real-time eye blink and wink detection for object selection in HCI systems , 2018, Journal on Multimodal User Interfaces.

[7]  Carolyn K. Bensel,et al.  Use of Personal Protective Equipment in the Workplace , 2006 .

[8]  Kang Ryoung Park,et al.  Blink detection robust to various facial poses , 2010, Journal of Neuroscience Methods.

[9]  Päivi Majaranta,et al.  Eye Tracking and Eye-Based Human–Computer Interaction , 2014 .

[10]  Dariusz J. Sawicki,et al.  Head Movement Based Interaction in Mobility , 2018, Int. J. Hum. Comput. Interact..

[11]  P Blenkhorn,et al.  Controlling mouse pointer position using an infrared head-operated joystick. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  M. Golz,et al.  Evaluation of PERCLOS based current fatigue monitoring technologies , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[13]  Kwanghoon Sohn,et al.  Visual fatigue monitoring system based on eye-movement and eye-blink detection , 2011, Electronic Imaging.

[14]  Robert Schleicher,et al.  Blink Parameter as Indicators of Driver's Sleepiness - Possibilities and Limitations. , 2003 .

[15]  Feng Liu,et al.  Eye Blink Detection for Smart Glasses , 2013, 2013 IEEE International Symposium on Multimedia.

[16]  Ashish Kapoor,et al.  A real-time head nod and shake detector , 2001, PUI '01.

[17]  R J Fairbanks,et al.  RESEARCH ON VEHICLE-BASED DRIVER STATUS/PERFORMANCE MONITORING; DEVELOPMENT, VALIDATION, AND REFINEMENT OF ALGORITHMS FOR DETECTION OF DRIVER DROWSINESS. FINAL REPORT , 1994 .

[18]  Hari Singh Dhillon,et al.  Human Eye Tracking and Related Issues: A Review , 2012 .

[19]  Shin Yamamoto,et al.  Detection of consciousness degradation and concentration of a driver for friendly information service , 2001, IVEC2001. Proceedings of the IEEE International Vehicle Electronics Conference 2001. IVEC 2001 (Cat. No.01EX522).