Deeply Learned Pore-Scale Facial Features

Pore-scale facial features consist of pores, fine wrinkles, and hair, which commonly appear in the whole face region. Similar to iris features and fingerprint features, pore-scale facial features are one of the biometric features that can distinguish human identities. Most of the local features of biometric depend on hand-crafted design. However, such hand-crafted features rely heavily on human experience and are usually composed of complicated operations, costing a great deal of time. This paper introduces a novel pore-scale facial features - Deeply Learned Pore-scale Facial Features (DLPFF). We use Convolutional Neural Networks (CNNs) to learn discriminant representations of pore-scale facial features. Experiments show that our deep network based method outperforms the state-of-the-art methods on the Bosphorus database.

[1]  Kin-Man Lam,et al.  Pore-Scale Facial Features Matching Under 3D Morphable Model Constraint , 2017, CCCV.

[2]  Noah Snavely,et al.  Robust Global Translations with 1DSfM , 2014, ECCV.

[3]  Vincent Lepetit,et al.  Learning to Assign Orientations to Feature Points , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[5]  Vincent Lepetit,et al.  LIFT: Learned Invariant Feature Transform , 2016, ECCV.

[6]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[10]  Kin-Man Lam,et al.  Design and learn distinctive features from pore-scale facial keypoints , 2015, Pattern Recognit..

[11]  Mingrui Wu,et al.  Gradient descent optimization of smoothed information retrieval metrics , 2010, Information Retrieval.

[12]  Vincent Lepetit,et al.  A fast local descriptor for dense matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Rudy Lauwereins,et al.  Derivative-Based Scale Invariant Image Feature Detector With Error Resilience , 2014, IEEE Transactions on Image Processing.

[14]  Rahul Sukthankar,et al.  MatchNet: Unifying feature and metric learning for patch-based matching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[16]  Iasonas Kokkinos,et al.  Discriminative Learning of Deep Convolutional Feature Point Descriptors , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[17]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..