Attribute Estimation Using Multi-CNNs from Hand Images

The human hand is one of the primary biometric traits in person authentication. A hand image also includes a lot of attribute information such as gender, age, skin color, accessory, and etc. Most conventional methods for hand-based biometric recognition rely on one distinctive attribute like palmprint and fingerprint. The other attributes as gender, age, skin color and accessory known as soft biometrics are expected to help identify individuals but are rarely used for identification. This paper proposes an attribute estimation method using multi-convolutional neural network (CNN) from hand images. We specially design new multi-CNN architectures dedicated to estimating multiple attributes from hand images. We train and test our models using 11K Hands, which consists of more than 10,000 images with 7 attributes and ID. The experimental results demonstrate that the proposed method exhibits the efficient performance on attribute estimation.

[1]  Tanuj Kanchan,et al.  Anthropometry of hand in sex determination of dismembered remains - A review of literature. , 2011, Journal of forensic and legal medicine.

[2]  Mircea Nicolescu,et al.  Gender classification from hand shape , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Ajay Kumar,et al.  Incorporating Cohort Information for Reliable Palmprint Authentication , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[4]  R. Lazenby,et al.  Identification of sex from metacarpals: effect of side asymmetry. , 1994, Journal of forensic sciences.

[5]  Mohamed R. Amer,et al.  Facial Attributes Classification Using Multi-task Representation Learning , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Arun Ross,et al.  What Else Does Your Biometric Data Reveal? A Survey on Soft Biometrics , 2016, IEEE Transactions on Information Forensics and Security.

[7]  Yang Zhong,et al.  Face attribute prediction using off-the-shelf CNN features , 2016, 2016 International Conference on Biometrics (ICB).

[8]  David Zhang,et al.  A survey of palmprint recognition , 2009, Pattern Recognit..

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[11]  Miguel A. Ferrer,et al.  Low Cost Multimodal Biometric identification System Based on Hand Geometry, Palm and Finger Print Texture , 2007, 2007 41st Annual IEEE International Carnahan Conference on Security Technology.

[12]  Bülent Sankur,et al.  Shape-based hand recognition , 2006, IEEE Transactions on Image Processing.

[13]  J L Scheuer,et al.  Sex determination from metacarpals and the first proximal phalanx. , 1993, Journal of forensic sciences.

[14]  David Zhang Palmprint Authentication , 2004, International Series on Biometrics.

[15]  Rama Chellappa,et al.  Attributes for Improved Attributes: A Multi-Task Network Utilizing Implicit and Explicit Relationships for Facial Attribute Classification , 2017, AAAI.

[16]  A. Falsetti,et al.  Sex assessment from metacarpals of the human hand. , 1995, Journal of forensic sciences.

[17]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[18]  Mahmoud Afifi,et al.  11K Hands: Gender recognition and biometric identification using a large dataset of hand images , 2017, Multimedia Tools and Applications.

[19]  David Zhang,et al.  Hand shape recognition based on coherent distance shape contexts , 2012, Pattern Recognit..