A gene expression programming approach for evolving multi-class image classifiers

This paper presents a methodology to perform multi-class image classification using Gene Expression Programming(GEP) in both balanced and unbalanced datasets. Descriptors are extracted from images and then their dimensionality are reduced by applying Principal Component Analysis. The aspects extracted from images are texture, color and shape that are, later, concatenated in a feature vector. Finally, GEP is used to evolve trees capable of performing as classifiers using the features as terminals. The quality of the solution evolved is evaluated by the introduced Cross-Entropy-Loss-based fitness function and compared with standard fitness function (both accuracy and product of sensibility and specificity). A novel GEP function linker Softmax-based is introduced. GEP performance is compared with the obtained by classifiers with tree structure, as C4.5 and Random Forest algorithms. Results show that GEP is capable of evolving classifiers able to achieve satisfactory results for image multi-class classification.

[1]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[2]  V. Mani,et al.  Multi-Temporal Satellite Image Analysis Using Gene Expression Programming , 2012, SocProS.

[3]  Heitor Silvério Lopes,et al.  Data mining with a parallel rule induction system based on gene expression programming , 2011 .

[4]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[5]  Yeshavanta Kubusada,et al.  Crop Classification Using Gene Expression Programming Technique , 2013 .

[6]  Rajkumar Roy,et al.  Soft Computing and Industry: Recent Applications , 2002 .

[7]  Chuang Deng,et al.  A Novel Multiclass Classification Method with Gene Expression Programming , 2009, 2009 International Conference on Web Information Systems and Mining.

[8]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[9]  Heitor Silverio Lopes,et al.  Multi-class classification of objects in images using principal component analysis and genetic programming , 2015, 2015 Latin America Congress on Computational Intelligence (LA-CCI).

[10]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[11]  Cândida Ferreira,et al.  Gene Expression Programming: A New Adaptive Algorithm for Solving Problems , 2001, Complex Syst..

[12]  Weimin Xiao,et al.  Evolving accurate and compact classification rules with gene expression programming , 2003, IEEE Trans. Evol. Comput..

[13]  Oren Barkan,et al.  Fast High Dimensional Vector Multiplication Face Recognition , 2013, 2013 IEEE International Conference on Computer Vision.

[14]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[15]  Zhuang Yu,et al.  Prediction of lung cancer based on serum biomarkers by gene expression programming methods. , 2014, Asian Pacific journal of cancer prevention : APJCP.

[16]  Zhijian Wu,et al.  Evolving Classification Rules by Unconstrained Gene Expression Programming , 2009, 2009 International Workshop on Intelligent Systems and Applications.

[17]  Heitor Silvério Lopes,et al.  Gene Expression Programming for Evolving Two-Dimensional Cellular Automata in a Distributed Environment , 2014, IDC.

[18]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[19]  Tao Sun,et al.  An Improved Canny Edge Detection Algorithm , 2013, 2014 IEEE International Conference on Mechatronics and Automation.

[20]  Zhu Liu,et al.  Multimedia content analysis-using both audio and visual clues , 2000, IEEE Signal Process. Mag..

[21]  Xiangyang Wang,et al.  Robust image retrieval based on color histogram of local feature regions , 2010, Multimedia Tools and Applications.