Gait-Watch: A Gait-based context-aware authentication system for smart watch via sparse coding

Abstract In recent years, wrist-worn smart devices such as smart wrist band and smart watch have pervaded our everyday life. Under this trend, the security issue of these wearable devices has received considerable attention as these devices usually store various private information. Conventional methods, however, do not provide a good user experience because they either depend on a secret PIN number input or require an explicit user authentication process. In this paper, we present Gait-watch, a context-aware authentication system for smart watch based on gait recognition. We address the problem of recognizing the user under various walking activities (e.g., walking normally, walking upstairs and walking with calling the phone), and propose a feature extraction method from gait signals to improve recognition accuracy. Extensive evaluations show that Gait-watchimproves recognition accuracy by up to 30.2% by leveraging the activity information, and can achieve 3.5% Equal Error Rate (EER). We also report a user study to demonstrate that Gait-watchcan accurately authenticate the user in real-world scenarios and require low system cost.

[1]  Cem Ersoy,et al.  Online Human Activity Recognition on Smart Phones , 2012 .

[2]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Lama Nachman,et al.  Unobtrusive gait verification for mobile phones , 2014, SEMWEB.

[5]  Jin Li,et al.  A novel method of micro-Doppler parameter extraction for human monitoring terahertz radar network , 2017, Ad Hoc Networks.

[6]  Gary M. Weiss,et al.  Cell phone-based biometric identification , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[7]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[8]  Neil W. Bergmann,et al.  Sensor-Assisted Face Recognition System on Smart Glass via Multi-View Sparse Representation Classification , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[9]  Wen Hu,et al.  Radio-based device-free activity recognition with radio frequency interference , 2015, IPSN.

[10]  Prasant Misra,et al.  Energy efficient GPS acquisition with Sparse-GPS , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[11]  Jie Yang,et al.  Smartphone based user verification leveraging gait recognition for mobile healthcare systems , 2013, 2013 IEEE International Conference on Sensing, Communications and Networking (SECON).

[12]  Heikki Ailisto,et al.  Unobtrusive Multimodal Biometrics for Ensuring Privacy and Information Security with Personal Devices , 2006, Pervasive.

[13]  Kirsi Helkala,et al.  Biometric Gait Authentication Using Accelerometer Sensor , 2006, J. Comput..

[14]  Einar Snekkenes,et al.  Robustness of Biometric Gait Authentication Against Impersonation Attack , 2006, OTM Workshops.

[15]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Zhaohui Wu,et al.  Accelerometer-Based Gait Recognition by Sparse Representation of Signature Points With Clusters , 2015, IEEE Transactions on Cybernetics.

[17]  Michael Weber,et al.  Password entry usability and shoulder surfing susceptibility on different smartphone platforms , 2012, MUM.

[18]  Gregory D. Abowd,et al.  The smart floor: a mechanism for natural user identification and tracking , 2000, CHI Extended Abstracts.

[19]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[20]  Rajesh Kumar,et al.  Context-Aware Active Authentication Using Smartphone Accelerometer Measurements , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[21]  Mark S. Nixon,et al.  A floor sensor system for gait recognition , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[22]  Paul J. M. Havinga,et al.  A Survey of Online Activity Recognition Using Mobile Phones , 2015, Sensors.

[23]  Markus Dürmuth,et al.  Quantifying the security of graphical passwords: the case of android unlock patterns , 2013, CCS.

[24]  Mikko Lindholm,et al.  Identifying people from gait pattern with accelerometers , 2005, SPIE Defense + Commercial Sensing.

[25]  Nathan L. Clarke,et al.  Unobtrusive Gait Recognition Using Smartwatches , 2017, 2017 International Conference of the Biometrics Special Interest Group (BIOSIG).

[26]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[27]  Ibrahim Khalil,et al.  Data mining in mobile ECG based biometric identification , 2014, J. Netw. Comput. Appl..

[28]  Wen Hu,et al.  Face recognition on smartphones via optimised Sparse Representation Classification , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[29]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[30]  Gary M. Weiss,et al.  Smartwatch-based biometric gait recognition , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[31]  Thomas Wolf,et al.  Multi-view gait recognition using 3D convolutional neural networks , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[32]  Tanzeem Choudhury,et al.  Passive and In-Situ assessment of mental and physical well-being using mobile sensors , 2011, UbiComp '11.

[33]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[34]  Huaxiang Zhang,et al.  A Weighted Sparse Neighbourhood-Preserving Projections for Face Recognition , 2017 .

[35]  Shie Mannor,et al.  Activity and Gait Recognition with Time-Delay Embeddings , 2010, AAAI.

[36]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[37]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Nitesh Saxena,et al.  Walk-Unlock: Zero-Interaction Authentication Protected with Multi-Modal Gait Biometrics , 2016, ArXiv.

[39]  Paul Thomas,et al.  Efficient DCT-based secret key generation for the Internet of Things , 2019, Ad Hoc Networks.

[40]  Christoph Busch,et al.  Authentication of Smartphone Users Based on the Way They Walk Using k-NN Algorithm , 2012, 2012 Eighth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[41]  Wen Hu,et al.  Real-time classification via sparse representation in acoustic sensor networks , 2013, SenSys '13.

[42]  Siraj Ahmed Shaikh,et al.  Characteristic trade-offs in designing large-scale biometric-based identity management systems , 2010, J. Netw. Comput. Appl..

[43]  Neil W. Bergmann,et al.  Gait-Watch: A Context-Aware Authentication System for Smart Watch Based on Gait Recognition , 2017, 2017 IEEE/ACM Second International Conference on Internet-of-Things Design and Implementation (IoTDI).

[44]  Neil W. Bergmann,et al.  Gait-Key , 2017, ACM Trans. Sens. Networks.

[45]  Mojtaba Alizadeh,et al.  Authentication in mobile cloud computing: A survey , 2016, J. Netw. Comput. Appl..

[46]  Adam J. Aviv,et al.  Smudge Attacks on Smartphone Touch Screens , 2010, WOOT.

[47]  Yaakov Tsaig,et al.  Fast Solution of $\ell _{1}$ -Norm Minimization Problems When the Solution May Be Sparse , 2008, IEEE Transactions on Information Theory.

[48]  Alessio Vecchio,et al.  Gait-based authentication using a wrist-worn device , 2016, MobiQuitous.

[49]  Neil W. Bergmann,et al.  Walkie-Talkie: Motion-Assisted Automatic Key Generation for Secure On-Body Device Communication , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[50]  Kjersti Engan,et al.  Multi-frame compression: theory and design , 2000, Signal Process..