Fast Training and Real-Time Classification Algorithm Based on Principal Component Analysis and F-Transform

While machine learning algorithms become more and more accurate in image processing tasks, their computation complexity becomes less important because they can be run on more and more powerful hardware. In this work, we are considering the computation complexity of a machine learning algorithm training/classification phase as the major criterion. The main aim is given to the Principal Component Analysis algorithm, which is examined, its drawbacks are point-out and suppressed by the proposed combination with the F-transform technique. We show that the training phase of such a combination is very fast, which is caused by the fact that both PCA and F-transform algorithms reduce dimensionality. In the designed benchmark, we show that the success rate of the fast hybrid algorithm is the same as the original PCA, due to F-transform ability to capture spatial information and reduction of noise/distortion in an image. Finally, we demonstrate that PCA+FT is faster and can achieve a higher success rate than a standard Convolution Neural Network and nevertheless, it is slightly less accurate as a Capsule Neural Network for the chosen dataset, its training phase is 100000x faster and classification time is faster 9x.

[1]  Tao Liu,et al.  Fault diagnosis of a mine hoist using PCA and SVM techniques , 2008 .

[2]  I. Jolliffe Principal Component Analysis and Factor Analysis , 1986 .

[3]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[4]  Irina Perfilieva,et al.  F-transform and discrete convolution , 2015, IFSA-EUSFLAT.

[5]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[6]  James Demmel,et al.  Fast linear algebra is stable , 2006, Numerische Mathematik.

[7]  Petr Hurtík,et al.  An image recognition approach to classification of jewelry stone defects , 2013, 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS).

[8]  Petr Hurtík,et al.  A hybrid image compression algorithm based on JPEG and Fuzzy transform , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[9]  Sriganesh Madhvanath,et al.  Principal component analysis for online handwritten character recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  Qian Du,et al.  Hyperspectral Image Compression Using JPEG2000 and Principal Component Analysis , 2007, IEEE Geoscience and Remote Sensing Letters.

[11]  김대진 A Numeral Character Recognition Using the PCA Mixture Model , 2000 .

[12]  Irina Perfilieva,et al.  Influence of various types of basic functions on image reconstruction using F-transform , 2013, EUSFLAT Conf..

[13]  Kuldip K. Paliwal,et al.  Fast principal component analysis using fixed-point algorithm , 2007, Pattern Recognit. Lett..

[14]  Hashim Habiballa,et al.  Recognition of damaged letters based on mathematical fuzzy logic analysis , 2015, J. Appl. Log..

[15]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[16]  Qiang Wang,et al.  Benchmarking State-of-the-Art Deep Learning Software Tools , 2016, 2016 7th International Conference on Cloud Computing and Big Data (CCBD).

[17]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[18]  Daoqiang Zhang,et al.  (2D)2PCA: Two-directional two-dimensional PCA for efficient face representation and recognition , 2005, Neurocomputing.

[19]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[20]  Irina Perfilieva,et al.  Fuzzy transforms: Theory and applications , 2006, Fuzzy Sets Syst..

[21]  Salvatore Sessa,et al.  Image reduction method based on the F-transform , 2017, Soft Comput..

[22]  Petr Hurtík,et al.  Differentiation by the F-transform and application to edge detection , 2016, Fuzzy Sets Syst..

[23]  Humberto Bustince,et al.  Interval-valued fuzzy sets constructed from matrices: Application to edge detection , 2009, Fuzzy Sets Syst..

[24]  Luis Mateus Rocha,et al.  Singular value decomposition and principal component analysis , 2003 .

[25]  Department of Electrical,et al.  Computational and Performance Aspects of PCA-Based Face-Recognition Algorithms , 2001, Perception.

[26]  Petr Hurtík,et al.  Pattern matching: overview, benchmark and comparison with F-transform general matching algorithm , 2017, Soft Computing.

[27]  Marek Vajgl,et al.  Automatic license plate recognition in difficult conditions — Technical report , 2017, 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS).

[28]  Michal Holcapek,et al.  A smoothing filter based on fuzzy transform , 2011, Fuzzy Sets Syst..

[29]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Marek Vajgl,et al.  Advanced F-Transform-Based Image Fusion , 2012, Adv. Fuzzy Syst..

[31]  M. S. Bewoor,et al.  Face Recognition using Principle Component Analysis , 2012 .

[32]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[33]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[34]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .