EmgAuth: An EMG-based Smartphone Unlocking System Using Siamese Network

Screen lock is a critical security feature for smart-phones to prevent unauthorized access. Although various screen unlocking technologies including fingerprint and facial recognition have been widely adopted, they still have some limitations. For example, fingerprints can be stolen by special material stickers and facial recognition systems can be cheated by 3D-printed head models. In this paper, we propose EmgAuth, a novel electromyography(EMG)-based smartphone unlocking system based on the Siamese network. EmgAuth leverages the Myo armband to collect the EMG data of smartphone users and enables users to unlock their smartphones when picking up and watching their smartphones. In particular, when training the Siamese network, we design a special data augmentation technique to make the system resilient to the rotation of the armband. We conduct experiments including 40 participants and the evaluation results show that EmgAuth can effectively authenticate users with an average true acceptance rate of 91.81% while keeping the average false acceptance rate of 7.43%. In addition, we also demonstrate that EmgAuth can work well for smartphones with different sizes and at different locations, and is applicable for users with different postures. EmgAuth bears great promise to serve as a good supplement for existing screen unlocking systems to improve the safety of smartphones.

[1]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[2]  Anil K. Jain,et al.  On-line fingerprint verification , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[3]  Fabian Monrose,et al.  Keystroke dynamics as a biometric for authentication , 2000, Future Gener. Comput. Syst..

[4]  John Daugman,et al.  How iris recognition works , 2002, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Steven Furnell,et al.  Authentication of users on mobile telephones - A survey of attitudes and practices , 2005, Comput. Secur..

[6]  Kirsi Helkala,et al.  Biometric Gait Authentication Using Accelerometer Sensor , 2006, J. Comput..

[7]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[8]  Kongqiao Wang,et al.  Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors , 2009, IUI.

[9]  Othman Omran Khalifa,et al.  EMG signal classification for human computer interaction: a review , 2009 .

[10]  Alan C. Bovik,et al.  The Essential Guide to Image Processing , 2009, J. Electronic Imaging.

[11]  Roberto Merletti,et al.  Advances in surface EMG: recent progress in clinical research applications. , 2010, Critical reviews in biomedical engineering.

[12]  Othman O. Khalifa,et al.  Electromygraphy (EMG) signal based hand gesture recognition using artificial neural network (ANN) , 2011, 2011 4th International Conference on Mechatronics (ICOM).

[13]  Huosheng Hu,et al.  CES-513 Stages for Developing Control Systems using EMG and EEG Signals: A survey , 2011 .

[14]  Yong Wang,et al.  Smartphone Security Challenges , 2012, Computer.

[15]  S. R. Mahadeva Prasanna,et al.  Multimodal Biometric Person Authentication : A Review , 2012 .

[16]  Yoshiaki Hayashi,et al.  An EMG-Based Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Damon L. Woodard,et al.  Biometric Authentication and Identification using Keystroke Dynamics: A Survey , 2012 .

[18]  Nitesh Saxena,et al.  Wave-to-Access: Protecting Sensitive Mobile Device Services via a Hand Waving Gesture , 2013, CANS.

[19]  Nasir D. Memon,et al.  Online Signature Verification on Mobile Devices , 2014, IEEE Transactions on Information Forensics and Security.

[20]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[21]  J. H. You,et al.  Effects of innovative virtual reality game and EMG biofeedback on neuromotor control in cerebral palsy. , 2014, Bio-medical materials and engineering.

[22]  Hisaaki Yamaba,et al.  An Authentication Method Independent of Tap Operation on the Touchscreen of a Mobile Device , 2015, J. Robotics Netw. Artif. Life.

[23]  K. I. Ramachandran,et al.  Cosine distance features for robust speaker verification , 2015, INTERSPEECH.

[24]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[25]  Wu Liu,et al.  Siamese neural network based gait recognition for human identification , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[27]  Lijun Zhao,et al.  Development of a hybrid motion capture method using MYO armband with application to teleoperation , 2016, 2016 IEEE International Conference on Mechatronics and Automation.

[28]  Mithileysh Sathiyanarayanan,et al.  MYO Armband for physiotherapy healthcare: A case study using gesture recognition application , 2016, 2016 8th International Conference on Communication Systems and Networks (COMSNETS).

[29]  Hisaaki Yamaba,et al.  Evaluation of feature values of surface electromyograms for user authentication on mobile devices , 2016, Artificial Life and Robotics.

[30]  João Marcelo X. N. Teixeira,et al.  Evaluating Sign Language Recognition Using the Myo Armband , 2016, 2016 XVIII Symposium on Virtual and Augmented Reality (SVR).

[31]  Shuicheng Yan,et al.  LG-CNN: From local parts to global discrimination for fine-grained recognition , 2017, Pattern Recognit..

[32]  Youn Tae Kim,et al.  A study of an EMG-based authentication algorithm using an artificial neural network , 2017, 2017 IEEE SENSORS.

[33]  Marco E. Benalcázar,et al.  Hand gesture recognition using machine learning and the Myo armband , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[34]  Arsalane Zarghili,et al.  Comparison between Euclidean and Manhattan distance measure for facial expressions classification , 2017, 2017 International Conference on Wireless Technologies, Embedded and Intelligent Systems (WITS).

[35]  Vincent Becker,et al.  Touchsense: classifying finger touches and measuring their force with an electromyography armband , 2018, UbiComp.

[36]  Minoru Fukumi,et al.  Personal Authentication and Hand Motion Recognition based on Wrist EMG Analysis by a Convolutional Neural Network , 2018, 2018 IEEE International Conference on Internet of Things and Intelligence System (IOTAIS).

[37]  Fang Hao,et al.  D-STC: Deep learning with spatio-temporal constraints for train drivers detection from videos , 2019, Pattern Recognit. Lett..