A survey of fingerprint classification Part II: Experimental analysis and ensemble proposal

Abstract In the first part of this paper we reviewed the fingerprint classification literature from two different perspectives: the feature extraction and the classifier learning. Aiming at answering the question of which among the reviewed methods would perform better in a real implementation we ended up in a discussion which showed the difficulty in answering this question. No previous comparison exists in the literature and comparisons among papers are done with different experimental frameworks. Moreover, the difficulty in implementing published methods was stated due to the lack of details in their description, parameters and the fact that no source code is shared. For this reason, in this paper we will go through a deep experimental study following the proposed double perspective. In order to do so, we have carefully implemented some of the most relevant feature extraction methods according to the explanations found in the corresponding papers and we have tested their performance with different classifiers, including those specific proposals made by the authors. Our aim is to develop an objective experimental study in a common framework, which has not been done before and which can serve as a baseline for future works on the topic. This way, we will not only test their quality, but their reusability by other researchers and will be able to indicate which proposals could be considered for future developments. Furthermore, we will show that combining different feature extraction models in an ensemble can lead to a superior performance, significantly increasing the results obtained by individual models.

[1]  Anil K. Jain,et al.  Adaptive flow orientation-based feature extraction in fingerprint images , 1995, Pattern Recognit..

[2]  Jun Li,et al.  Combining singular points and orientation image information for fingerprint classification , 2008, Pattern Recognit..

[3]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[5]  Ryan M. Rifkin,et al.  In Defense of One-Vs-All Classification , 2004, J. Mach. Learn. Res..

[6]  Boris Bratnina AKADEMSKO PISANJE U DRUŠTVENIM NAUKAMA , 2011 .

[7]  G. McLachlan Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[8]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[9]  Sharath Pankanti,et al.  Filterbank-based fingerprint matching , 2000, IEEE Trans. Image Process..

[10]  Francisco Herrera,et al.  An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes , 2011, Pattern Recognit..

[11]  Francisco Herrera,et al.  Prototype Selection for Nearest Neighbor Classification: Taxonomy and Empirical Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Francisco Herrera,et al.  Analyzing the presence of noise in multi-class problems: alleviating its influence with the One-vs-One decomposition , 2012, Knowledge and Information Systems.

[13]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[14]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[15]  Xudong Jiang,et al.  Fingerprint Reference-Point Detection , 2005, EURASIP J. Adv. Signal Process..

[16]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[17]  Dario Maio,et al.  A Multi-Classifier Approach to Fingerprint Classification , 2002, Pattern Analysis & Applications.

[18]  Anil K. Jain,et al.  FVC2000: Fingerprint Verification Competition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Anil K. Jain,et al.  Fingerprint classification , 1996, Pattern Recognit..

[20]  A. R. Rao,et al.  A Taxonomy for Texture Description and Identification , 1990, Springer Series in Perception Engineering.

[21]  Mikel Galar,et al.  Minutiae filtering to improve both efficacy and efficiency of fingerprint matching algorithms , 2014, Eng. Appl. Artif. Intell..

[22]  J H Wegstein,et al.  An automated fingerprint identification system , 1982 .

[23]  Kristin L. Sainani,et al.  Logistic Regression , 2014, PM & R : the journal of injury, function, and rehabilitation.

[24]  L. A. Stone,et al.  Computer Aided Design of Experiments , 1969 .

[25]  Ka-Chung Leung,et al.  Improvement of Fingerprint Retrieval by a Statistical Classifier , 2011, IEEE Transactions on Information Forensics and Security.

[26]  Philip S. Yu,et al.  Top 10 algorithms in data mining , 2007, Knowledge and Information Systems.

[27]  Nixon,et al.  Feature Extraction & Image Processing , 2008 .

[28]  Sabih H. Gerez,et al.  Systematic Methods for the Computation of the Directional Fields and Singular Points of Fingerprints , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Haesun Park,et al.  Fingerprint classification using fast Fourier transform and nonlinear discriminant analysis , 2005, Pattern Recognit..

[30]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[31]  Adnan Amin,et al.  Fingerprint classification: a review , 2004, Pattern Analysis and Applications.

[32]  P. Shanti Sastry,et al.  Fingerprint classification using a feedback-based line detector , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Francisco Herrera,et al.  A unifying view on dataset shift in classification , 2012, Pattern Recognit..

[34]  Yoram Singer,et al.  Logistic Regression, AdaBoost and Bregman Distances , 2000, Machine Learning.

[35]  Xudong Jiang,et al.  Fingerprint Retrieval by Complex Filter Responses , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[36]  Ramesh C. Jain,et al.  Vector field analysis for oriented patterns , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  Francisco Herrera,et al.  A survey of fingerprint classification Part II , 2015 .

[38]  Lin Wang,et al.  Application of a new type of singular points in fingerprint classification , 2007, Pattern Recognit. Lett..

[39]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[40]  Sung-Bae Cho,et al.  Fingerprint classification using one-vs-all support vector machines dynamically ordered with naive Bayes classifiers , 2008, Pattern Recognit..

[41]  Josef Bigün,et al.  Localization of corresponding points in fingerprints by complex filtering , 2003, Pattern Recognit. Lett..

[42]  Francisco Herrera,et al.  Genetics-Based Machine Learning for Rule Induction: State of the Art, Taxonomy, and Comparative Study , 2010, IEEE Transactions on Evolutionary Computation.

[43]  Jun Li,et al.  Constrained nonlinear models of fingerprint orientations with prediction , 2006, Pattern Recognit..

[44]  Theofanis Sapatinas,et al.  Discriminant Analysis and Statistical Pattern Recognition , 2005 .

[45]  Anil K. Jain,et al.  FVC2002: Second Fingerprint Verification Competition , 2002, Object recognition supported by user interaction for service robots.

[46]  Xin Yao,et al.  Multiclass Imbalance Problems: Analysis and Potential Solutions , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  Raffaele Cappelli,et al.  SFinGe : an Approach to Synthetic Fingerprint Generation , 2004 .

[48]  Tony R. Martinez,et al.  Improved Heterogeneous Distance Functions , 1996, J. Artif. Intell. Res..

[49]  Guohua Geng,et al.  Fingerprint Image Segmentation by Energy of Gaussian-Hermite Moments , 2004, SINOBIOMETRICS.

[50]  Davide Maltoni,et al.  Fingerprint verification competition 2006 , 2007 .

[51]  Francisco Herrera,et al.  Empowering difficult classes with a similarity-based aggregation in multi-class classification problems , 2014, Inf. Sci..

[52]  Alessandra Lumini,et al.  Fingerprint Classification by Directional Image Partitioning , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Francisco Herrera,et al.  DRCW-OVO: Distance-based relative competence weighting combination for One-vs-One strategy in multi-class problems , 2015, Pattern Recognit..

[54]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[55]  Samir Al-Khayatt,et al.  Fast Robust Fingerprint Feature Extraction and Classification , 2004, J. Intell. Robotic Syst..

[56]  E. R. Davies,et al.  Thinning algorithms: A critique and a new methodology , 1981, Pattern Recognit..

[57]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[58]  Hoang Thien Van,et al.  Fingerprint reference point detection for image retrieval based on symmetry and variation , 2012, Pattern Recognit..

[59]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[60]  Marcel Abendroth,et al.  Data Mining Practical Machine Learning Tools And Techniques With Java Implementations , 2016 .

[61]  Francisco Herrera,et al.  Study on the Impact of Partition-Induced Dataset Shift on $k$-Fold Cross-Validation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[62]  Anil K. Jain,et al.  A Multichannel Approach to Fingerprint Classification , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  David G. Stork,et al.  Pattern Classification , 1973 .

[64]  Anil K. Jain,et al.  FVC2004: Third Fingerprint Verification Competition , 2004, ICBA.

[65]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[66]  Akio Tojo,et al.  Fingerprint pattern classification , 1984, Pattern Recognit..

[67]  Dario Maio,et al.  Multispace KL for Pattern Representation and Classification , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[69]  Huaijiang Sun,et al.  A gradient-based combined method for the computation of fingerprints' orientation field , 2009, Image Vis. Comput..

[70]  Mikel Galar,et al.  Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approaches , 2013, Knowl. Based Syst..

[71]  Bernadette Dorizzi,et al.  Fingerprint and On-Line Signature Verification Competitions at ICB 2009 , 2009, ICB.

[72]  Bir Bhanu,et al.  Fingerprint classification based on learned features , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[73]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[74]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[75]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[76]  Kai Huang,et al.  Fingerprint Classification Based on Extraction and Analysis of Singularities and Pseudoridges , 2001, VIP.

[77]  Sabih H. Gerez,et al.  Segmentation of Fingerprint Images , 2001 .

[78]  Lukasz A. Kurgan,et al.  Impact of imputation of missing values on classification error for discrete data , 2008, Pattern Recognit..

[79]  Chiao-fe Shu,et al.  Direct estimation and error analysis for oriented patterns , 1993 .

[80]  Manhua Liu,et al.  Fingerprint classification based on Adaboost learning from singularity features , 2010, Pattern Recognit..

[81]  Babu M. Mehtre,et al.  Segmentation of fingerprint images using the directional image , 1987, Pattern Recognit..

[82]  Craig I. Watson,et al.  PCASYS- A Pattern-Level Classification Automation System for Fingerprints | NIST , 1995 .

[83]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[84]  Stephen F. Smith,et al.  Flexible Learning of Problem Solving Heuristics Through Adaptive Search , 1983, IJCAI.