Securitas: user identification through RGB-NIR camera pair on mobile devices

Today mobile devices are equipped with numerous sensors and new ones are being added. In this paper, we propose a method to utilize a new sensor to provide a more secure identification system named Securitas for mobile device users. Securitas is a user identification system through the use of RGB-NIR camera pairs. The system extracts and analyzes geometrical features from a human hand to identify the user for unlocking devices and accessing personal data. Utilizing both RGB and the NIR cameras for real skin detection, it can effectively prevent an impostor from gaining access by using a fake hand photograph of a valid registered user without limitations of contrast, color, and background. Comparing to existing techniques, Securitas demonstrates that by leveraging the sensors on the mobile devices, a user can have a more secure identification mechanism by simply taking a photograph of his hand. Through proof of concept of implementation, our system demonstrates the ability to distinguish users with more than 94% accuracy.

[1]  Michael Goh Kah Ong,et al.  A single-sensor hand geometry and palmprint verification system , 2003, WBMA '03.

[2]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  Jun Yang,et al.  SenGuard: Passive user identification on smartphones using multiple sensors , 2011, 2011 IEEE 7th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[4]  Sharath Pankanti,et al.  A Prototype Hand Geometry-based Verication System , 1999 .

[5]  Anil K. Jain,et al.  Heterogeneous Face Recognition: Matching NIR to Visible Light Images , 2010, 2010 20th International Conference on Pattern Recognition.

[6]  N. Suvonvorn,et al.  Real-time face detection/identification for surveillance system , 2008, 2008 International Conference on Electronic Design.

[7]  Josef Kittler,et al.  Fusion of visible and synthesised near infrared information for face authentication , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Thomas Serre,et al.  A Component-based Framework for Face Detection and Identification , 2007, International Journal of Computer Vision.

[9]  R. Myneni,et al.  The interpretation of spectral vegetation indexes , 1995 .

[10]  Mauro Conti,et al.  Mind how you answer me!: transparently authenticating the user of a smartphone when answering or placing a call , 2011, ASIACCS '11.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Michael J. Mendenhall,et al.  Detection of Human Skin in Near Infrared Hyperspectral Imagery , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[13]  Xiao Wang,et al.  SenSec: Mobile security through passive sensing , 2013, 2013 International Conference on Computing, Networking and Communications (ICNC).

[14]  Alessandro Zimmer,et al.  Hand geometry: a new approach for feature extraction , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).