Exploring orientation and accelerometer sensor data for personal authentication in smartphones using touchscreen gestures

A novel approach for user verification in smartphones using touchscreen gestures.Performance of the approach is evaluated on relatively large dataset of 104 users.Orientation sensor information outperforms other features considered in this work.Proposed approach achieves 0.31% EER for score level fusion of all gestures. In this paper, we propose an approach for user authentication in smartphones using behavioral biometrics. The approach involves analyzing behavioral traits while the user performs different gestures during his interaction with the device. In addition to the commonly employed features such as x-y coordinate information and finger area, the proposed approach utilizes the information from orientation sensor for each of the seven gestures considered in this study. The feature set is further enriched with features such as accelerometer sensor reading, curvature of the swipe. Matching of corresponding features is performed using the modified Hausdorff distance. Performance evaluation of the proposed authentication approach on a dataset of 104 users yielded promising results, suggesting that the readings from orientation sensor carry useful information for reliably authenticating the users. In addition, experimental results demonstrate that consolidating multiple features results in performance improvement. The proposed method outperforms dynamic time warping based matching for all gestures considered in this study, with significant reduction in EER from 1.55% to 0.31% for score level fusion of all gestures. In addition, the performance of the proposed algorithm is ascertained on a dataset of 30 subjects captured using another smartphone.

[1]  Alessandro Neri,et al.  User authentication using keystroke dynamics for cellular phones , 2009 .

[2]  Zhigang Liu,et al.  Darwin phones: the evolution of sensing and inference on mobile phones , 2010, MobiSys '10.

[3]  Herbert Reininger,et al.  Continuous Speaker Verification in Realtime , 2011, BIOSIG.

[4]  Youtian Du,et al.  User Authentication Through Mouse Dynamics , 2013, IEEE Transactions on Information Forensics and Security.

[5]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[6]  Kwang-Seok Hong,et al.  Multimodal biometric authentication using teeth image and voice in mobile environment , 2008, IEEE Transactions on Consumer Electronics.

[7]  Duncan S. Wong,et al.  Touch Gestures Based Biometric Authentication Scheme for Touchscreen Mobile Phones , 2012, Inscrypt.

[8]  Ioannis A. Kakadiaris,et al.  Mobile User Authentication Using Statistical Touch Dynamics Images , 2014, IEEE Transactions on Information Forensics and Security.

[9]  Sungzoon Cho,et al.  Keystroke dynamics-based authentication for mobile devices , 2009, Comput. Secur..

[10]  Jeroen Breebaart,et al.  Deleted DOI: Multichannel Coding of Applause Signals , 2008 .

[11]  Steven Furnell,et al.  Surveying the Development of Biometric User Authentication on Mobile Phones , 2015, IEEE Communications Surveys & Tutorials.

[12]  Prasant Mohapatra,et al.  Sensor-assisted facial recognition: an enhanced biometric authentication system for smartphones , 2014, MobiSys.

[13]  Steven Furnell,et al.  Keystroke dynamics on a mobile handset: a feasibility study , 2003, Inf. Manag. Comput. Secur..

[14]  Christoph Busch,et al.  Fingerprint Recognition with Embedded Cameras on Mobile Phones , 2011, MobiSec.

[15]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[16]  B. V. K. Vijaya Kumar,et al.  Face authentication from cell phone camera images with illumination and temporal variations , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[17]  Dawn Xiaodong Song,et al.  Touchalytics: On the Applicability of Touchscreen Input as a Behavioral Biometric for Continuous Authentication , 2012, IEEE Transactions on Information Forensics and Security.

[18]  P. Bhattarakosol,et al.  Authenticating User Using Keystroke Dynamics and Finger Pressure , 2009, 2009 6th IEEE Consumer Communications and Networking Conference.

[19]  Heinrich Hußmann,et al.  Touch me once and i know it's you!: implicit authentication based on touch screen patterns , 2012, CHI.

[20]  Lei Zhang,et al.  Palmprint Verification on Mobile Phones Using Accelerated Competitive Code , 2011, 2011 International Conference on Hand-Based Biometrics.

[21]  Nasir D. Memon,et al.  Multitouch Gesture-Based Authentication , 2014, IEEE Transactions on Information Forensics and Security.

[22]  Tao Feng,et al.  Continuous mobile authentication using touchscreen gestures , 2012, 2012 IEEE Conference on Technologies for Homeland Security (HST).

[23]  Xinjian Chen,et al.  A Secured Mobile Phone Based on Embedded Fingerprint Recognition Systems , 2005, ISI.

[24]  Tao Feng,et al.  Continuous mobile authentication using a novel Graphic Touch Gesture Feature , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[25]  Kang Ryoung Park,et al.  A Study on Iris Localization and Recognition on Mobile Phones , 2008, EURASIP J. Adv. Signal Process..

[26]  Matti Pietikäinen,et al.  Face and Eye Detection for Person Authentication in Mobile Phones , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[27]  Anderson Rocha,et al.  Robust Fusion: Extreme Value Theory for Recognition Score Normalization , 2010, ECCV.

[28]  Issa Traoré,et al.  Biometric Recognition Based on Free-Text Keystroke Dynamics , 2014, IEEE Transactions on Cybernetics.

[29]  Ajay Kumar,et al.  Contactless finger knuckle identification using smartphones , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[30]  Ahmed Awad E. Ahmed,et al.  A New Biometric Technology Based on Mouse Dynamics , 2007, IEEE Transactions on Dependable and Secure Computing.

[31]  Lee Luan Ling,et al.  User authentication through typing biometrics features , 2005 .

[32]  Christophe Rosenberger,et al.  Challenge-based speaker recognition for mobile authentication , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[33]  Paulo Lobato Correia,et al.  Smartphone-based palmprint recognition system , 2014, 2014 21st International Conference on Telecommunications (ICT).

[34]  Matti Pietikäinen,et al.  Bi-Modal Person Recognition on a Mobile Phone: Using Mobile Phone Data , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[35]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[36]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Muhammad Ali Akbar,et al.  Secure biometric template generation for multi-factor authentication , 2015, Pattern Recognit..

[38]  N. Poh,et al.  Mobile Biometrics: Combined Face and Voice Verification for a Mobile Platform , 2013, IEEE Pervasive Computing.

[39]  Tao Feng,et al.  TIPS: context-aware implicit user identification using touch screen in uncontrolled environments , 2014, HotMobile.

[40]  Paolo Abeni,et al.  Implementing Biometrics-Based Authentication for Mobile Devices , 2006 .

[41]  Tieniu Tan,et al.  Embedded Palmprint Recognition System on Mobile Devices , 2007, ICB.

[42]  Sébastien Marcel,et al.  Bi-modal biometric authentication on mobile phones in challenging conditions , 2014, Image Vis. Comput..

[43]  Kwang-Seok Hong,et al.  Person authentication using face, teeth and voice modalities for mobile device security , 2010, IEEE Transactions on Consumer Electronics.

[44]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..