Pattern recognition system: from classical methods to deep learning techniques

Abstract. Performance of modern automated pattern recognition (PR) systems is heavily influenced by accuracy of their feature extraction algorithm. Many papers have demonstrated uses of deep learning techniques in PR, but there is little evidence on using them as feature extractors. Our goal is to contribute to this field and perform a comparative study between classical used methods in feature extraction and deep learning techniques. For that, a biometric recognition system, which is a PR application, is developed and evaluated using a proposed evaluation metric called expected risk probability. In our study, two deeply learned features, based on PCANet and DCTNet deep learning techniques, are used with two biometric modalities that are palmprint and palm-vein. Subsequently, the efficiency of these techniques is compared with various classical feature extraction methods. From the obtained results, we drew our conclusions on a very positive impact of deep learning techniques on overall recognition rate, and thus these techniques significantly outperform the classical techniques.

[1]  Shiguang Shan,et al.  Face video retrieval with image query via hashing across Euclidean space and Riemannian manifold , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Liang Lu,et al.  Adaptive DCTNet for audio signal classification , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Tara N. Sainath,et al.  The shared views of four research groups ) , 2012 .

[4]  Yan Liu,et al.  Deep object recognition across domains based on adaptive extreme learning machine , 2017, Neurocomputing.

[5]  Motahareh Taheri Robust face recognition via non-linear correlation filter bank , 2018, IET Image Process..

[6]  Maleika Heenaye-Mamode Khan,et al.  Analysing Factors Affecting Hand Biometrics during Image Capture , 2014, ANT/SEIT.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Christoph Busch,et al.  Efficient BSIF-based near-infrared iris recognition , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[9]  Chhaya Sunil Khandelwal,et al.  Review Paper on Applications of Principal Component Analysis in Multimodal Biometrics System , 2016 .

[10]  C.-H. Lee,et al.  Dorsal hand vein recognition based on 2D Gabor filters , 2014 .

[11]  Kang Ryoung Park,et al.  Multimodal biometric authentication based on the fusion of finger vein and finger geometry , 2009 .

[12]  David Zhang,et al.  Online finger-knuckle-print verification for personal authentication , 2010, Pattern Recognit..

[13]  Andreas Uhl,et al.  Empirical Evaluation of LBP-Extension Features for Finger Vein Spoofing Detection , 2016, 2016 International Conference of the Biometrics Special Interest Group (BIOSIG).

[14]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[15]  Jun Zhang,et al.  Local Energy Pattern for Texture Classification Using Self-Adaptive Quantization Thresholds , 2013, IEEE Transactions on Image Processing.

[16]  Ahmed Bouridane,et al.  Palmprint and Finger-Knuckle-Print for efficient person recognition based on Log-Gabor filter response , 2011 .

[17]  John V. Monaco,et al.  The Partially Observable Hidden Markov Model with Application to Keystroke Biometrics , 2016, ArXiv.

[18]  Yuan Yan Tang,et al.  Facial Biometrics Using Nontensor Product Wavelet and 2D Discriminant Techniques , 2009, Int. J. Pattern Recognit. Artif. Intell..

[19]  Khalid Satori,et al.  Face Recognition Using Local Binary Probabilistic Pattern (LBPP) and 2D-DCT Frequency Decomposition , 2016, 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV).

[20]  Erik Marchi,et al.  A novel approach for automatic acoustic novelty detection using a denoising autoencoder with bidirectional LSTM neural networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Puneet Gupta,et al.  An accurate infrared hand geometry and vein pattern based authentication system , 2016, Knowl. Based Syst..

[22]  Cristinel Codrescu,et al.  RBF-FIRMLP Architecture for Digit Recognition , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[23]  Caifeng Shan,et al.  Learning local binary patterns for gender classification on real-world face images , 2012, Pattern Recognit. Lett..

[24]  Lianwen Jin,et al.  DLANet: A manifold-learning-based discriminative feature learning network for scene classification , 2015, Neurocomputing.

[25]  Quoc V. Le,et al.  Measuring Invariances in Deep Networks , 2009, NIPS.

[26]  R. Bhavani,et al.  Human activity recognition in egocentric video using PNN, SVM, kNN and SVM+kNN classifiers , 2017, Cluster Computing.

[27]  Abhishek Kumar Gangwar,et al.  Color local phase quantization (CLPQ)- A new face representation approach using color texture cues , 2015, 2015 International Conference on Biometrics (ICB).

[28]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[29]  Wenhao Zhang,et al.  Gender and gaze gesture recognition for human-computer interaction , 2016, Comput. Vis. Image Underst..

[30]  Wasfy B. Mikhael,et al.  Efficient facial recognition using vector quantization of 2D DWT features , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[31]  Arab Ali Chérif,et al.  Human Ear recognition based on Multi-scale Local Binary Pattern descriptor and KL divergence , 2016, 2016 39th International Conference on Telecommunications and Signal Processing (TSP).

[32]  Zhenhua Guo,et al.  An Online System of Multispectral Palmprint Verification , 2010, IEEE Transactions on Instrumentation and Measurement.

[33]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[34]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[35]  Chu He,et al.  Image classification with a deep network model based on compressive sensing , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[36]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[37]  Önsen Toygar,et al.  Spoof detection on face and palmprint biometrics , 2017, Signal, Image and Video Processing.

[38]  Ping Liu,et al.  A comparison of random forest regression and multiple linear regression for prediction in neuroscience , 2013, Journal of Neuroscience Methods.

[39]  Chu He,et al.  A deep graph embedding network model for face recognition , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[40]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[41]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.