Discriminative Viewer Identification using Generative Models of Eye Gaze

We study the problem of identifying viewers of arbitrary images based on their eye gaze. Psychological research has derived generative stochastic models of eye movements. In order to exploit this background knowledge within a discriminatively trained classification model, we derive Fisher kernels from different generative models of eye gaze. Experimentally, we find that the performance of the classifier strongly depends on the underlying generative model. Using an SVM with Fisher kernel improves the classification performance over the underlying generative model.

[1]  Soumava Kumar Roy,et al.  Human identification using Linear Multiclass SVM and Eye Movement biometrics , 2015, 2015 Eighth International Conference on Contemporary Computing (IC3).

[2]  Hong-Jun Yoon,et al.  Gaze as a biometric , 2014, Medical Imaging.

[3]  Michel Pasquier,et al.  Biometric identification using the dynamic features of the eyes , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[4]  Tomi Kinnunen,et al.  Towards task-independent person authentication using eye movement signals , 2010, ETRA.

[5]  Ruth E. Hogg,et al.  Individual differences in human eye movements: An oculomotor signature? , 2017, Vision Research.

[6]  Reinhold Kliegl,et al.  A Model of Individual Differences in Gaze Control During Reading , 2014, EMNLP.

[7]  Ioannis Rigas,et al.  Biometric Recognition via Eye Movements: Saccadic Vigor and Acceleration Cues , 2016, TAP.

[8]  Daniel L. Silver,et al.  Keystroke and Eye-Tracking Biometrics for User Identification , 2006, IC-AI.

[9]  Jyrki Rasku,et al.  Biometric verification of a subject through eye movements , 2013, Comput. Biol. Medicine.

[10]  Oleg V. Komogortsev,et al.  Complex eye movement pattern biometrics: Analyzing fixations and saccades , 2013, 2013 International Conference on Biometrics (ICB).

[11]  Aurobinda Routray,et al.  A score level fusion method for eye movement biometrics , 2016, Pattern Recognit. Lett..

[12]  R. Baloh,et al.  Quantitative measurement of saccade amplitude, duration, and velocity , 1975, Neurology.

[13]  Pawel Kasprowski,et al.  Eye Movements in Biometrics , 2004, ECCV Workshop BioAW.

[14]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[15]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[16]  Matthias Roetting,et al.  Entering PIN codes by smooth pursuit eye movements , 2014 .

[17]  Virgilio Gómez-Rubio,et al.  Spatial Point Patterns: Methodology and Applications with R , 2016 .

[18]  Tobias Scheffer,et al.  A Discriminative Model for Identifying Readers and Assessing Text Comprehension from Eye Movements , 2018, ECML/PKDD.

[19]  M. Pickering,et al.  Eye guidance in reading and scene perception , 1998 .

[20]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[21]  Ioannis Rigas,et al.  Biometric identification based on the eye movements and graph matching techniques , 2012, Pattern Recognit. Lett..

[22]  Heiko H. Schütt,et al.  Likelihood-Based Parameter Estimation and Comparison of Dynamical Cognitive Models , 2016, Psychological review.

[23]  Vu C. Dinh,et al.  Mel-frequency Cepstral Coefficients for Eye Movement Identification , 2012, 2012 IEEE 24th International Conference on Tools with Artificial Intelligence.

[24]  Bogdan Hoanca,et al.  Gaze-based password authentication through automatic clustering of gaze points , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[25]  Simon Barthelmé,et al.  Spatial statistics and attentional dynamics in scene viewing. , 2014, Journal of vision.

[26]  Patrick Olivier,et al.  Gaze-contingent passwords at the ATM , 2008 .

[27]  Oleg V. Komogortsev,et al.  Biometric identification via eye movement scanpaths in reading , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[28]  Tomi Kinnunen,et al.  Eye-Movements as a Biometric , 2005, SCIA.

[29]  Heinrich Hußmann,et al.  Eyepass - eye-stroke authentication for public terminals , 2008, CHI Extended Abstracts.

[30]  Martti Juhola,et al.  Biometric verification of a subject with eye movements, with special reference to temporal variability in saccades between a subject's measurements , 2014, Int. J. Biom..

[31]  S. Sridharan,et al.  Gaze based user authentication for personal computer applications , 2004, Proceedings of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004..

[32]  Ivan Martinovic,et al.  Preventing Lunchtime Attacks: Fighting Insider Threats With Eye Movement Biometrics , 2015, NDSS.

[33]  Reinhold Kliegl,et al.  A Semiparametric Model for Bayesian Reader Identification , 2016, EMNLP.

[34]  Tal Garfinkel,et al.  Reducing shoulder-surfing by using gaze-based password entry , 2007, SOUPS '07.