3D Fingerprint Recognition based on Ridge-Valley-Guided 3D Reconstruction and 3D Topology Polymer Feature Extraction

Automated fingerprint recognition system (AFRS) for 3D fingerprints is essential and highly promising in biometric security. Despite the progress in 3D AFRSs, high-quality real-time 3D fingerprint reconstruction and high-accuracy 3D fingerprint recognition remain two challenging issues. To address these issues, we propose a robust 3D AFRS based on ridge-valley-guided 3D fingerprint reconstruction and 3D topology feature extraction. The proposed 3D fingerprint reconstruction considers the unique fingerprint characteristic of ridge-valley (RV) and achieves real-time reconstruction. Different from traditional triangulation-based methods that establish correspondence between points by cross-correlation-based searching, we propose to establish RV correspondence (RVC) between ridges/valleys by defining and calculating a RVC matrix based on the topology of RV curves. To enhance depth reconstruction, curve-based smoothing is proposed to refine our novel RV disparity map. The proposed 3D fingerprint recognition is based on three-dimensional topology polymer (TTP) feature extraction. The TTP codes 3D topology by projecting the 3D minutiae onto multiple planes and extracting their corresponding 2D topologies, which has proven to be effective and efficient. Comprehensive experimental results demonstrate that our method outperforms the state-of-the-art methods in terms of both reconstruction and recognition accuracy. Thanks to the significantly short running time, our method is applicable to practical applications.

[1]  Davide Maltoni,et al.  Minutia Cylinder-Code: A New Representation and Matching Technique for Fingerprint Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Xiaoyue Jiang,et al.  3-D Ultrasonic Fingerprint Sensor-on-a-Chip , 2016, IEEE Journal of Solid-State Circuits.

[3]  Egidijus Auksorius,et al.  Fast subsurface fingerprint imaging with full-field optical coherence tomography system equipped with a silicon camera , 2017, Journal of biomedical optics.

[4]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Nalini K. Ratha,et al.  Robust fingerprint authentication using local structural similarity , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[6]  Kirill V Larin,et al.  Artificial fingerprint recognition by using optical coherence tomography with autocorrelation analysis. , 2006, Applied optics.

[7]  Jiankun Hu,et al.  A Delaunay Quadrangle-Based Fingerprint Authentication System With Template Protection Using Topology Code for Local Registration and Security Enhancement , 2014, IEEE Transactions on Information Forensics and Security.

[8]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[9]  Ajay Kumar,et al.  Towards Contactless, Low-Cost and Accurate 3D Fingerprint Identification , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  TicoMarius,et al.  Fingerprint Matching Using an Orientation-Based Minutia Descriptor , 2003 .

[11]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[12]  Roman Gr. Maev,et al.  High-speed biometrics ultrasonic system for 3D fingerprint imaging , 2012, Optics/Photonics in Security and Defence.

[13]  Adam Wax,et al.  Design and implementation of a low-cost, portable OCT system. , 2018, Biomedical optics express.

[14]  David Zhang,et al.  Study on novel Curvature Features for 3D fingerprint recognition , 2015, Neurocomputing.

[15]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[16]  Yan Zhao,et al.  3D fingerprint imaging system based on full-field fringe projection profilometry , 2014 .

[17]  B. Boser,et al.  Monolithic ultrasound fingerprint sensor , 2017, Microsystems & Nanoengineering.

[18]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Ronald Chung,et al.  Real-time three-dimensional fingerprint acquisition via a new photometric stereo means , 2013 .

[20]  Jiankun Hu,et al.  Latent fingerprint segmentation based on convolutional neural networks , 2017, 2017 IEEE Workshop on Information Forensics and Security (WIFS).

[21]  Les A. Piegl,et al.  Delaunay triangulation in three dimensions , 1995, IEEE Computer Graphics and Applications.

[22]  Francisco Herrera,et al.  A survey on fingerprint minutiae-based local matching for verification and identification: Taxonomy and experimental evaluation , 2015, Inf. Sci..

[23]  Marc Pollefeys,et al.  A multiple-camera system calibration toolbox using a feature descriptor-based calibration pattern , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Christoph Busch,et al.  Volumetric fingerprint data analysis using Optical Coherence Tomography , 2013, 2013 International Conference of the BIOSIG Special Interest Group (BIOSIG).

[25]  Vincenzo Piuri,et al.  Toward Unconstrained Fingerprint Recognition: A Fully Touchless 3-D System Based on Two Views on the Move , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[26]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[27]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[28]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Xudong Jiang,et al.  Fingerprint minutiae matching based on the local and global structures , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[30]  John M. Libert,et al.  Contactless fingerprint devices usability test , 2017 .

[31]  Feng Liu,et al.  3D fingerprint reconstruction system using feature correspondences and prior estimated finger model , 2014, Pattern Recognit..

[32]  Jianjiang Feng,et al.  Combining minutiae descriptors for fingerprint matching , 2008, Pattern Recognit..

[33]  Laurence G. Hassebrook,et al.  Very high resolution 3D surface scanning using multi-frequency phase measuring profilometry , 2005, SPIE Defense + Commercial Sensing.

[34]  Ajay Kumar,et al.  Tetrahedron Based Fast 3D Fingerprint Identification Using Colored LEDs Illumination , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Martial Hebert,et al.  Automatic Three-Dimensional Point Cloud Processing for Forest Inventory , 2006 .

[36]  Rudolf Hauke,et al.  The Surround ImagerTM: A Multi-camera Touchless Device to Acquire 3D Rolled-Equivalent Fingerprints , 2006, ICB.

[37]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[38]  Zhan Song,et al.  Extracting Valley-Ridge Lines from Point-Cloud-Based 3D Fingerprint Models , 2013, IEEE Computer Graphics and Applications.

[39]  Venu Govindaraju,et al.  Fingerprint enhancement using STFT analysis , 2007, Pattern Recognit..

[40]  Laurence G. Hassebrook,et al.  Data Acquisition and Processing of 3-D Fingerprints , 2010, IEEE Transactions on Information Forensics and Security.