Electromyograph and keystroke dynamics for spoof-resistant biometric authentication

Biometrics has come a long way over the past decade in terms of technologies and devices that are used to verify user identities. Three of the more well studied modalities in this field are the face, iris and fingerprint, with the latter two reporting very high user identification/verification rates. In the biometric community there has been little work in studying biomedical signals for user recognition purposes. In this paper, we propose using electromyograph (EMG) signals as a person's biometric signature. The EMG records the motor unit action potentials (MUAP) during any physical motion. Our study is done within the context of a person using a keyboard to type a password or any other fixed phrase. Along with EMG signals, we log key press times for the user and study the feasibility of using this data too as a biometric feature. Keypress timings alone if used as a biometric, are very easy to spoof and hence we fuse this modality with EMG signals. In order to classify these features, we use subspace modeling as well as Bayesian classifiers. The experiments have been performed within the context of a user typing a fixed pass phrase at a workstation. The idea is to monitor both biometric modalities when this action is performed and study user verification across data capture sessions and within capture sessions. Our approach yields high values of verification rates, which shows the promise of using these modalities as user specific biometric signatures.

[1]  Marios Savvides,et al.  Facial Ethnic Appearance Synthesis , 2014, ECCV Workshops.

[2]  Sung-Hyuk Cha,et al.  Performance of a long-text-input keystroke biometric authentication system using an improved k-nearest-neighbor classification method , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[3]  Marios Savvides,et al.  Robust local binary pattern feature sets for periocular biometric identification , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[4]  Othman Omran Khalifa,et al.  EMG signal classification for human computer interaction: a review , 2009 .

[5]  Marios Savvides,et al.  Subspace-Based Discrete Transform Encoded Local Binary Patterns Representations for Robust Periocular Matching on NIST’s Face Recognition Grand Challenge , 2014, IEEE Transactions on Image Processing.

[6]  Marios Savvides,et al.  Unconstrained periocular biometric acquisition and recognition using COTS PTZ camera for uncooperative and non-cooperative subjects , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[7]  A. Adler,et al.  Images can be regenerated from quantized biometric match score data , 2004, Canadian Conference on Electrical and Computer Engineering 2004 (IEEE Cat. No.04CH37513).

[8]  Marios Savvides,et al.  An image statistics approach towards efficient and robust refinement for landmarks on facial boundary , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[9]  Honggang Zhang,et al.  Comments on "Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Application to Face and Palm Biometrics" , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Arun Ross,et al.  Investigating the Discriminative Power of Keystroke Sound , 2015, IEEE Transactions on Information Forensics and Security.

[11]  Ching Y. Suen,et al.  Investigating age invariant face recognition based on periocular biometrics , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[12]  Sahin Albayrak,et al.  Continuous and non-intrusive identity verification in real-time environments based on free-text keystroke dynamics , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[13]  Roy A. Maxion,et al.  Comparing anomaly-detection algorithms for keystroke dynamics , 2009, 2009 IEEE/IFIP International Conference on Dependable Systems & Networks.

[14]  Marios Savvides,et al.  Weight-Optimal Local Binary Patterns , 2014, ECCV Workshops.

[15]  Winnie Jensen,et al.  Simultaneous and Proportional Force Estimation in Multiple Degrees of Freedom From Intramuscular EMG , 2012, IEEE Transactions on Biomedical Engineering.

[16]  Xiaoming Liu,et al.  On Continuous User Authentication via Typing Behavior , 2014, IEEE Transactions on Image Processing.

[17]  Silvestro Micera,et al.  Characterization of EMG Patterns From Proximal Arm Muscles During Object- and Orientation-Specific Grasps , 2009, IEEE Transactions on Biomedical Engineering.

[18]  Zongda Wu,et al.  Similarity Match in Time Series Streams under Dynamic Time Warping Distance , 2008, 2008 International Conference on Computer Science and Software Engineering.

[19]  George N. Saridis,et al.  EMG Pattern Analysis and Classification for a Prosthetic Arm , 1982, IEEE Transactions on Biomedical Engineering.

[20]  Marios Savvides,et al.  Gait-ID on the move: Pace independent human identification using cell phone accelerometer dynamics , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[21]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[22]  Robert M. Haralick,et al.  Prosthesis Control Using a Nearest Neighbor Electromyographic Pattern Classifier , 1983, IEEE Transactions on Biomedical Engineering.

[23]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[24]  Marios Savvides,et al.  Driver cell phone usage detection on Strategic Highway Research Program (SHRP2) face view videos , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[25]  D. Hatzinakos,et al.  ECG Biometric Recognition Without Fiducial Detection , 2006, 2006 Biometrics Symposium: Special Session on Research at the Biometric Consortium Conference.

[26]  Marios Savvides,et al.  A preliminary investigation on the sensitivity of COTS face recognition systems to forensic analyst-style face processing for occlusions , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[27]  Marios Savvides,et al.  An Augmented Linear Discriminant Analysis Approach for Identifying Identical Twins with the Aid of Facial Asymmetry Features , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[28]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[29]  A. Willsky,et al.  Upper Extremity Limb Function Discrimination Using EMG Signal Analysis , 1983, IEEE Transactions on Biomedical Engineering.

[30]  Marios Savvides,et al.  Hallucinating the Full Face from the Periocular Region via Dimensionally Weighted K-SVD , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[31]  S. J. Shepherd Continuous authentication by analysis of keyboard typing characteristics , 1995 .

[32]  Marios Savvides,et al.  Can your eyebrows tell me who you are? , 2011, 2011 5th International Conference on Signal Processing and Communication Systems (ICSPCS).

[33]  Leslie Pack Kaelbling,et al.  State-based Classification of Finger Gestures from Electromyographic Signals , 2000, ICML.

[34]  Claudia Picardi,et al.  Keystroke analysis of free text , 2005, TSEC.

[35]  Jian Yang,et al.  Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Applications to Face and Palm Biometrics , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Marios Savvides,et al.  Correlation Pattern Recognition for Face Recognition , 2006, Proceedings of the IEEE.

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Desney S. Tan,et al.  Making muscle-computer interfaces more practical , 2010, CHI.

[39]  Marios Savvides,et al.  How to Generate Spoofed Irises From an Iris Code Template , 2011, IEEE Transactions on Information Forensics and Security.

[40]  Yu Hen Hu,et al.  One-lead ECG for identity verification , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[41]  Marios Savvides,et al.  NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[42]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.