Robust Head Mounted Wearable Eye Tracking System for Dynamical Calibration

In this work, a new head mounted eye tracking system is presented. Based on computer vision techniques, the system integrates eye images and head movement, in real time, performing a robust gaze point tracking. Nystagmus movements due to vestibulo-ocular reflex are monitored and integrated. The system proposed here is a strongly improved version of a previous platform called HATCAM, which was robust against changes of illumination conditions. The new version, called HAT-Move, is equipped with accurate inertial motion unit to detect the head movement enabling eye gaze even in dynamical conditions. HAT-Move performance is investigated in a group of healthy subjects in both static and dynamic conditions, i.e. when head is kept still or free to move. Evaluation was performed in terms of amplitude of the angular error between the real coordinates of the fixed points and those computed by the system in two experimental setups, specifically, in laboratory settings and in a 3D virtual reality (VR) scenario. The achieved results showed that HAT-Move is able to achieve eye gaze angular error of about 1 degree along both horizontal and vertical directions

[1]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[2]  Naoki Saito,et al.  A Method to Detect and Characterize Ellipses Using the Hough Transform , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Karen M. Evans,et al.  Collecting and Analyzing Eye-Tracking Data in Outdoor Environments , 2012 .

[4]  Enzo Pasquale Scilingo,et al.  On the deconvolution analysis of electrodermal activity in bipolar patients , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Enzo Pasquale Scilingo,et al.  Eye tracking and pupil size variation as response to affective stimuli: A preliminary study , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[6]  Jeff B. Pelz,et al.  Head movement estimation for wearable eye tracker , 2004, ETRA.

[7]  Enzo Pasquale Scilingo,et al.  A novel EDA glove based on textile-integrated electrodes for affective computing , 2012, Medical & Biological Engineering & Computing.

[8]  Enzo Pasquale Scilingo,et al.  Improving emotion recognition systems by embedding cardiorespiratory coupling , 2013, Physiological measurement.

[9]  Jeff B. Pelz,et al.  The wearable eyetracker: a tool for the study of high-level visual tasks , 2003 .

[10]  U. Bronfenbrenner.  Toward an Experimental Ecology of Human Development. , 1977 .

[11]  K. Pawlik,et al.  Ambulatory Assessment - Monitoring Behavior in Daily Life Settings A Behavioral-Scientific Challenge for Psychology , 2007 .

[12]  Eliseo Stefano Maini.  Robust Ellipse-Specific Fitting for Real-Time Machine Vision , 2005, BVAI.

[13]  Enzo Pasquale Scilingo,et al.  An FPGA Based Arrhythmia Recognition System for Wearable Applications , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[14]  T Vilis,et al.  Axes of eye rotation and Listing's law during rotations of the head. , 1991, Journal of neurophysiology.

[15]  Enzo Pasquale Scilingo,et al.  Towards a smart glove: Arousal recognition based on textile Electrodermal Response , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[16]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[17]  Li Liu,et al.  Calibration algorithm for eyetracking with unrestricted head movement , 2007, Behavior research methods.

[18]  E. Scilingo,et al.  Dominant Lyapunov exponent and approximate entropy in heart rate variability during emotional visual elicitation , 2012, Front. Neuroeng..

[19]  John M Findlay,et al.  Saccadic eye movement programming: sensory and attentional factors , 2009, Psychological research.

[20]  Jakob de Lemos,et al.  Measuring emotions using eye tracking , 2008 .

[21]  Enzo Pasquale Scilingo,et al.  Comparitive study on photometric normalization algorithms for an innovative, robust and real-time eye gaze tracker , 2011, Journal of Real-Time Image Processing.

[22]  M. A. Frens,et al.  Recording eye movements with video-oculography and scleral search coils: a direct comparison of two methods , 2002, Journal of Neuroscience Methods.

[23]  Enzo Pasquale Scilingo,et al.  Robotic Social Therapy on Children with Autism: Preliminary Evaluation through Multi-parametric Analysis , 2012, SocialCom/PASSAT.

[24]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[25]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[26]  Thomas Martinetz,et al.  A Single-Camera Remote Eye Tracker , 2006, PIT.

[27]  Juan J. Cerrolaza,et al.  Taxonomic study of polynomial regressions applied to the calibration of video-oculographic systems , 2008, ETRA.

[28]  Enzo Pasquale Scilingo,et al.  Eye gaze patterns in emotional pictures , 2012, Journal of Ambient Intelligence and Humanized Computing.

[29]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[30]  Alessandro Tognetti,et al.  Advanced interfaces to stem the data deluge in mixed reality: placing human (un)consciousness in the loop , 2013, SIGGRAPH '13.

[31]  Enzo Pasquale Scilingo,et al.  Robust multiple cardiac arrhythmia detection through bispectrum analysis , 2011, Expert Syst. Appl..

[32]  Johannes Wagner,et al.  A sensing architecture for empathetic data systems , 2013, AH.

[33]  Gintautas Daunys,et al.  Investigation of Calibration Techniques in Video Based Eye Tracking System , 2008, ICCHP.

[34]  Laura Chamberlain.  Eye Tracking Methodology; Theory and Practice , 2007 .

[35]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[36]  Enzo Pasquale Scilingo,et al.  Robotic Social Therapy on Children with Autism: Preliminary Evaluation through Multi-parametric Analysis , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[37]  Gaetano Valenza,et al.  Mood recognition in bipolar patients through the PSYCHE platform: Preliminary evaluations and perspectives , 2013, Artif. Intell. Medicine.

[38]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[39]  S. McKee,et al.  Visual acuity in the presence of retinal-image motion. , 1975, Journal of the Optical Society of America.

[40]  Carlos Hitoshi Morimoto,et al.  Pupil detection and tracking using multiple light sources , 2000, Image Vis. Comput..

[41]  Zhiwei Zhu,et al.  Novel Eye Gaze Tracking Techniques Under Natural Head Movement , 2007, IEEE Transactions on Biomedical Engineering.

[42]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[43]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Enzo Pasquale Scilingo,et al.  Wearable Monitoring for Mood Recognition in Bipolar Disorder Based on History-Dependent Long-Term Heart Rate Variability Analysis , 2014, IEEE Journal of Biomedical and Health Informatics.

[45]  Enzo Pasquale Scilingo,et al.  Comparative Evaluation of Susceptibility to Motion Artifact in Different Wearable Systems for Monitoring Respiratory Rate , 2010, IEEE Transactions on Information Technology in Biomedicine.

[46]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[47]  Carlos Hitoshi Morimoto,et al.  Detecting eye position and gaze from a single camera and 2 light sources , 2002, Object recognition supported by user interaction for service robots.