Privacy-Constrained Biometric System for Non-Cooperative Users

With the consolidation of the new data protection regulation paradigm for each individual within the European Union (EU), major biometric technologies are now confronted with many concerns related to user privacy in biometric deployments. When individual biometrics are disclosed, the sensitive information about his/her personal data such as financial or health are at high risk of being misused or compromised. This issue can be escalated considerably over scenarios of non-cooperative users, such as elderly people residing in care homes, with their inability to interact conveniently and securely with the biometric system. The primary goal of this study is to design a novel database to investigate the problem of automatic people recognition under privacy constraints. To do so, the collected data-set contains the subject’s hand and foot traits and excludes the face biometrics of individuals in order to protect their privacy. We carried out extensive simulations using different baseline methods, including deep learning. Simulation results show that, with the spatial features extracted from the subject sequence in both individual hand or foot videos, state-of-the-art deep models provide promising recognition performance.

[1]  Gholamreza Anbarjafari,et al.  Data Fusion Boosted Face Recognition Based on Probability Distribution Functions in Different Colour Channels , 2009, EURASIP J. Adv. Signal Process..

[2]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Gholamreza Anbarjafari,et al.  Volumetric Histogram-Based Alzheimer's Disease Detection Using Support Vector Machine. , 2019, Journal of Alzheimer's disease : JAD.

[4]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Yunhong Wang,et al.  Comparative Study of Deep Learning Methods on Dorsal Hand Vein Recognition , 2016, CCBR.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Gholamreza Anbarjafari,et al.  Video resolution enhancement by using discrete and stationary wavelet transforms with illumination compensation , 2015, Signal Image Video Process..

[8]  Simina Emerich,et al.  Dorsal hand vein recognition based on Riesz Wavelet Transform and Local Line Binary Pattern , 2017, 2017 3rd International Conference on Frontiers of Signal Processing (ICFSP).

[9]  REGULATION (EU) 2019/518 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL , 2015 .

[10]  Bojan Spasic,et al.  Security Pattern for Cloud SaaS: from system and data security to privacy , 2018, 2018 4th International Conference on Cloud Computing Technologies and Applications (Cloudtech).

[11]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[12]  Nicolae Duta,et al.  A survey of biometric technology based on hand shape , 2009, Pattern Recognit..

[13]  Sergio Escalera,et al.  Automatic Access Control Based on Face and Hand Biometrics in a Non-cooperative Context , 2018, 2018 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[14]  Lingyu Wang,et al.  A Thermal Hand Vein Pattern Verification System , 2005, ICAPR.

[15]  Guillermo Sapiro,et al.  Discriminative learned dictionaries for local image analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Gaurav Singal,et al.  Detailed Analysis of Footprint Geometry for Person Identification , 2017, 2017 13th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[17]  Amine Nait-Ali,et al.  Fusion of face recognition methods at score level , 2016, 2016 International Conference on Bio-engineering for Smart Technologies (BioSMART).

[18]  Chao Xu,et al.  Fusing shape and spatio-temporal features for depth-based dynamic hand gesture recognition , 2016, Multimedia Tools and Applications.

[19]  Sergio Escalera,et al.  Action Recognition Using Single-Pixel Time-of-Flight Detection , 2019, Entropy.

[20]  David Zhang,et al.  A sparse representation method of bimodal biometrics and palmprint recognition experiments , 2013, Neurocomputing.

[21]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[22]  Richa Singh,et al.  Group sparse representation based classification for multi-feature multimodal biometrics , 2016, Inf. Fusion.

[23]  Kanya Tanaka,et al.  Footprint-based personal recognition , 2000, IEEE Transactions on Biomedical Engineering.

[24]  Andreas Uhl,et al.  Footprint-based biometric verification , 2008, J. Electronic Imaging.

[25]  Jian Yang,et al.  Dorsal hand vein recognition based on convolutional neural networks , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[26]  Hironobu Takagi,et al.  Recognizing hand-object interactions in wearable camera videos , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[27]  Mounim A. El-Yacoubi,et al.  Deep Representation-Based Feature Extraction and Recovering for Finger-Vein Verification , 2017, IEEE Transactions on Information Forensics and Security.

[28]  Tülay Yildirim,et al.  Hand geometry identification without feature extraction by general regression neural network , 2008, Expert Syst. Appl..

[29]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Hao Zhang,et al.  Expression-insensitive 3D face recognition using sparse representation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Sergio Escalera,et al.  A novel deep network architecture for reconstructing RGB facial images from thermal for face recognition , 2019, Multimedia Tools and Applications.

[32]  Bernhard Schölkopf,et al.  Incorporating Invariances in Support Vector Learning Machines , 1996, ICANN.

[33]  R B Kennedy,et al.  Uniqueness of bare feet and its use as a possible means of identification. , 1996, Forensic science international.

[34]  V. D. Ambeth Kumar,et al.  EMPLOYMENT OF FOOTPRINT RECOGNITION SYSTEM , 2013 .

[35]  Ajay Kumar,et al.  Personal Authentication Using Hand Vein Triangulation and Knuckle Shape , 2009, IEEE Transactions on Image Processing.

[36]  James J. Little,et al.  Biometric Gait Recognition , 2003, Advanced Studies in Biometrics.

[37]  Helen C. Shen,et al.  Personal authentication using hand images , 2006, Pattern Recognit. Lett..

[38]  Nikola Paveši,et al.  Personal authentication using hand-geometry and palmprint features – the state of the art , 2004 .

[39]  Mircea Nicolescu,et al.  Peg-Free Hand Shape Verification Using High Order Zernike Moments , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[40]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Lu Yang,et al.  Survey on 3D Hand Gesture Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[44]  Gholamreza Anbarjafari,et al.  Emotion Recognition from Skeletal Movements , 2019, Entropy.

[45]  Hakim Doghmane,et al.  Face recognition using 1DLBP, DWT and SVM , 2015, 2015 3rd International Conference on Control, Engineering & Information Technology (CEIT).

[46]  Lingyu Wang,et al.  Minutiae feature analysis for infrared hand vein pattern biometrics , 2008, Pattern Recognit..

[47]  Patrizio Campisi,et al.  Security and Privacy in Biometrics , 2013, Springer London.

[48]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Jian-Feng Cai,et al.  Blind motion deblurring from a single image using sparse approximation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  Jin-Woo Jung,et al.  Dynamic-footprint based person identification using mat-type pressure sensor , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[51]  Septimiu Crisan,et al.  A Novel Perspective on Hand Vein Patterns for Biometric Recognition: Problems, Challenges, and Implementations , 2017 .

[52]  Ram Chandra Singh,et al.  Footprint-Based Personal Recognition using Scanning Technique , 2016 .

[53]  S L Barker,et al.  Predictive value of human footprints in a forensic context. , 1998, Medicine, science, and the law.