Deep Gaze Velocity Analysis During Mammographic Reading for Biometric Identification of Radiologists

Several studies have confirmed that the gaze velocity of the human eye can be utilized as a behavioral biometric or personalized biomarker. In this study, we leverage the local feature representation capacity of convolutional neural networks (CNNs) for eye gaze velocity analysis as the basis for biometric identification of radiologists performing breast cancer screening. Using gaze data collected from 10 radiologists reading 100 mammograms of various diagnoses, we compared the performance of a CNN-based classification algorithm with two deep learning classifiers, deep neural network and deep belief network, and a previously presented hidden Markov model classifier. The study showed that the CNN classifier is superior compared to alternative classification methods based on macro F1-scores derived from 10-fold cross-validation experiments. Our results further support the efficacy of eye gaze velocity as a biometric identifier of medical imaging experts.

[1]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[2]  Hong-Jun Yoon,et al.  Gaze as a biometric , 2014, Medical Imaging.

[3]  Michele Nappi,et al.  A New Gaze Analysis Based Soft-Biometric , 2013, MCPR.

[4]  Hong-Jun Yoon,et al.  Personalized modeling of human gaze: Exploratory investigation on mammogram readings , 2013, 2013 Biomedical Sciences and Engineering Conference (BSEC).

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Elizabeth A. Krupinski,et al.  Research and applications: Investigating the link between radiologists' gaze, diagnostic decision, and image content , 2013, J. Am. Medical Informatics Assoc..

[7]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[8]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Farzin Deravi,et al.  Gaze Trajectory as a Biometric Modality , 2011, BIOSIGNALS.

[11]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[12]  Ioannis Rigas,et al.  Biometric identification based on the eye movements and graph matching techniques , 2012, Pattern Recognit. Lett..

[13]  Vu C. Dinh,et al.  Mel-frequency Cepstral Coefficients for Eye Movement Identification , 2012, 2012 IEEE 24th International Conference on Tools with Artificial Intelligence.

[14]  Richard H. Moore,et al.  Current Status of the Digital Database for Screening Mammography , 1998, Digital Mammography / IWDM.

[15]  Hong-Jun Yoon,et al.  Temporal stability of visual search-driven biometrics , 2015, Medical Imaging.

[16]  Pawel Kasprowski,et al.  Eye Movements in Biometrics , 2004, ECCV Workshop BioAW.

[17]  Tomi Kinnunen,et al.  Towards task-independent person authentication using eye movement signals , 2010, ETRA.

[18]  Daniel Riccio,et al.  Biometric Authentication , 2014, Lecture Notes in Computer Science.

[19]  I. Pyykkö,et al.  Velocity patterns of rapid eye movements. , 1980, Acta oto-laryngologica.

[20]  Tomi Kinnunen,et al.  Eye-Movements as a Biometric , 2005, SCIA.

[21]  Ioannis Rigas,et al.  Biometric Recognition via Eye Movements: Saccadic Vigor and Acceleration Cues , 2016, TAP.

[22]  Daniel L. Silver,et al.  Keystroke and Eye-Tracking Biometrics for User Identification , 2006, IC-AI.

[23]  Sridha Sridharan,et al.  Gaze Based Personal Identification , 2010 .

[24]  L F Dell'Osso,et al.  Saccadic velocity characteristics: intrinsic variability and fatigue. , 1979, Aviation, space, and environmental medicine.

[25]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[26]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[27]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[28]  L. Eon Bottou Online Learning and Stochastic Approximations , 1998 .

[29]  Georgia D Tourassi,et al.  Predicting diagnostic error in radiology via eye-tracking and image analytics: preliminary investigation in mammography. , 2013, Medical physics.

[30]  G. D. Tourassi,et al.  Current Status of Computerized Decision Support Systems in Mammography , 2005 .

[31]  Clément Farabet,et al.  Torch7: A Matlab-like Environment for Machine Learning , 2011, NIPS 2011.

[32]  Oleg V. Komogortsev,et al.  Biometric verification via complex eye movements: The effects of environment and stimulus , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[33]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[34]  Jeff B. Pelz,et al.  Head movement estimation for wearable eye tracker , 2004, ETRA.