Pamls Alignment Based On Two-Stage Convolutional Network with a Large in-Plane Rotation

Palms alignment is an important work for palmprint recognition in uncontrolled environment. Many methods have made progress to achieve alignment. But most of them ignore the palm’s angles, which could not satisfy the alignment initialization when the hand has a large in-plane rotation. In this paper, we propose a palms alignment with affine transformation method based on a two-stage convolutional neural network (CNN). The basic idea is to rotate the target palm into the same angle category to avoid the following affine registration has a big matching error at the beginning. At the stage I, the given target palm is classified into two angle categories. At the stage II the upside down palm is firstly rotated 180 degrees, and then inputted into the subsequent feature extraction network, feature matching layer and regression network to achieve the affine alignment. Experimental results have proved the effectiveness of our method.

[1]  Bernt Schiele,et al.  Robust Object Detection with Interleaved Categorization and Segmentation , 2008, International Journal of Computer Vision.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[4]  David Zhang,et al.  Principal line based ICP alignment for palmprint verification , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  Wael Abd-Almageed,et al.  QATM: Quality-Aware Template Matching for Deep Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Ce Liu,et al.  Unsupervised Joint Object Discovery and Segmentation in Internet Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Cordelia Schmid,et al.  Proposal Flow: Semantic Correspondences from Object Proposals , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Adams Wai-Kin Kong,et al.  Palmprint Recognition in Uncontrolled and Uncooperative Environment , 2019, IEEE Transactions on Information Forensics and Security.

[9]  Yi Yang,et al.  Articulated Human Detection with Flexible Mixtures of Parts , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Josef Sivic,et al.  Convolutional Neural Network Architecture for Geometric Matching , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[13]  Qiuxia Wu,et al.  Contactless Palm Vein Recognition Using a Mutual Foreground-Based Local Binary Pattern , 2014, IEEE Transactions on Information Forensics and Security.

[14]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[15]  Qiushi Zhao,et al.  Sift-based image alignment for contactless palmprint verification , 2013, 2013 International Conference on Biometrics (ICB).

[16]  Dexing Zhong,et al.  Efficient Deep Palmprint Recognition via Distilled Hashing Coding , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Beatriz Quintino Ferreira,et al.  Video Analysis Based on Human Pose for Unsupervised Summarization and Retrieval , 2019, 2019 International Conference on Content-Based Multimedia Indexing (CBMI).

[19]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.