Eyelid contour detection and tracking for startle research related eye-blink measurements from high-speed video records

Using the positions of the eyelids is an effective and contact-free way for the measurement of startle induced eye-blinks, which plays an important role in human psychophysiological research. To the best of our knowledge, no methods for an efficient detection and tracking of the exact eyelid contours in image sequences captured at high-speed exist that are conveniently usable by psychophysiological researchers. In this publication a semi-automatic model-based eyelid contour detection and tracking algorithm for the analysis of high-speed video recordings from an eye tracker is presented. As a large number of images have been acquired prior to method development it was important that our technique is able to deal with images that are recorded without any special parametrisation of the eye tracker. The method entails pupil detection, specular reflection removal and makes use of dynamic model adaption. In a proof-of-concept study we could achieve a correct detection rate of 90.6%. With this approach, we provide a feasible method to accurately assess eye-blinks from high-speed video recordings.

[1]  David Mas,et al.  Noninvasive measurement of eye retraction during blinking. , 2010, Optics letters.

[2]  Choong Jae Lee,et al.  The Role of Müller's Muscle Reconsidered , 1998, Plastic and reconstructive surgery.

[3]  M. Bradley.  Natural selective attention: orienting and emotion. , 2009, Psychophysiology.

[4]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[5]  J. Büttner-Ennever,et al.  Nervous control of eyelid function. A review of clinical, experimental and pathological data. , 1992, Brain : a journal of neurology.

[6]  J. de Houwer,et al.  Implicit measures: A normative analysis and review. , 2009, Psychological bulletin.

[7]  Mark Hallett,et al.  TMS-induced blinking assessed with high-speed video: optical disruption of visual perception , 2011, Experimental Brain Research.

[8]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Christopher T Lovelace,et al.  Infrared reflectance as an alternative to EMG for measuring prepulse inhibition of startle eyeblink. , 2006, Psychophysiology.

[10]  Sravanti L. Sanivarapu.  Emotion , 2020, Indian journal of psychiatry.

[11]  Naphtali Rishe,et al.  A highly accurate and computationally efficient approach for unconstrained iris segmentation , 2010, Image Vis. Comput..

[12]  B. Cuthbert,et al.  Committee report: Guidelines for human startle eyeblink electromyographic studies. , 2005, Psychophysiology.

[13]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[14]  Huachun Tan,et al.  Detecting eye blink states by tracking iris and eyelids , 2006, Pattern Recognition Letters.

[15]  Peter M. Corcoran,et al.  Statistical models of appearance for eye tracking and eye-blink detection and measurement , 2008, IEEE Transactions on Consumer Electronics.

[16]  M. Bradley,et al.  Emotion, attention, and the startle reflex. , 1990, Psychological review.

[17]  W. K. Berg,et al.  Startle Modification: Startle Elicitation: Stimulus Parameters, Recording Techniques, and Quantification , 1999 .

[18]  M. Koch,et al.  The neurobiology of startle , 1999, Progress in Neurobiology.

[19]  Azriel Rosenfeld,et al.  A method of detecting and tracking irises and eyelids in video , 2002, Pattern Recognit..

[20]  Kang Ryoung Park,et al.  A study on eyelid localization considering image focus for iris recognition , 2008, Pattern Recognit. Lett..

[21]  Reza Derakhshani,et al.  An Ensemble Method for Classifying Startle Eyeblink Modulation from High-Speed Video Records , 2011, IEEE Transactions on Affective Computing.

[22]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Tieniu Tan,et al.  Robust eyelid, eyelash and shadow localization for iris recognition , 2008, 2008 15th IEEE International Conference on Image Processing.

[24]  C. Evinger,et al.  Eyelid movements. Mechanisms and normal data. , 1991, Investigative ophthalmology & visual science.

[25]  Tieniu Tan,et al.  Toward Accurate and Fast Iris Segmentation for Iris Biometrics , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Werner Frei,et al.  Fast Boundary Detection: A Generalization and a New Algorithm , 1977, IEEE Transactions on Computers.

[27]  Vladimir Vezhnevets,et al.  Robust and Accurate Eye Contour Extraction , 2003 .

[28]  Margrit Betke,et al.  Communication via eye blinks - detection and duration analysis in real time , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Hongbin Zha,et al.  A new method of detecting human eyelids based on deformable templates , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[30]  N. Frijda.  Emotion, cognitive structure and action tendency , 1987 .

[31]  Montse Pardàs,et al.  Extraction and tracking of the eyelids , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[32]  L. Bour,et al.  Neurophysiological aspects of eye and eyelid movements during blinking in humans. , 2000, Journal of neurophysiology.

[33]  David Mas,et al.  Blinking kinematics description through non-invasive measurement , 2011 .

[34]  Nikolaus Weiskopf,et al.  Infrared oculography—validation of a new method to monitor startle eyeblink amplitudes during fMRI , 2004, NeuroImage.

[35]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[36]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[37]  Richard P. Wildes,et al.  A machine-vision system for iris recognition , 2005, Machine Vision and Applications.

[38]  Michael E. Dawson,et al.  Startle Modification: Implications for Neuroscience, Cognitive Science, and Clinical Science , 2008 .

[39]  Diane L. Filion,et al.  Classification of startle eyeblink metrics using neural networks , 2009, 2009 International Joint Conference on Neural Networks.