Flower image segmentation with PCA fused colored covariance and gabor texture features based level sets

Abstract This paper presents a framework for segmenting flower images captured with a digital camera. Segmenting flowers from images is a complex problem attributed to translation, scaling, rotation with variable backgrounds in each captured image. We propose to solve this problem using principle component analysis based color texture fusion as a prior parameter for level set evolution (FCTAC). First, Color Gabor textures (CGT) and Color Level Covariance Matrix (CLCM) texture features are extracted. Principle component analysis based fusion constructs a color discriminative texture as a knowledge base with convex energy function for active contours without edges. The proposed global segmentation framework with fused textures will avoid the local minimums during curve evolution. We test the proposed segmentation model on the benchmark oxford flower image dataset and our own dataset. The results of FCTAC were tested against the state-of-the-art methods in accuracy and efficiency.

[1]  Yehoshua Y. Zeevi,et al.  Integrated active contours for texture segmentation , 2006, IEEE Transactions on Image Processing.

[2]  E. Zagrouba,et al.  Flower image segmentation based on color analysis and a supervised evaluation , 2012, 2012 International Conference on Communications and Information Technology (ICCIT).

[3]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[4]  Andrew Zisserman,et al.  Automated Flower Classification over a Large Number of Classes , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[5]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[6]  Yang Li,et al.  Automatic segmentation of dermoscopy images using saliency combined with Otsu threshold , 2017, Comput. Biol. Medicine.

[7]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[8]  Borja Millán,et al.  Grapevine flower estimation by applying artificial vision techniques on images with uncontrolled scene and multi-model analysis , 2015, Comput. Electron. Agric..

[9]  Martin K. Purvis,et al.  Improving superpixel-based image segmentation by incorporating color covariance matrix manifolds , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[10]  Ying Du,et al.  Egress Mechanism Color Image Segmentation Based on Region and Feature Fusion in Mars Exploration , 2017 .

[11]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[12]  Mohamed Deriche,et al.  A Fast Geodesic Active Contour Model for Medical Image Segmentation Using Prior Analysis and Wavelets , 2014 .

[13]  Andrew Zisserman,et al.  Delving deeper into the whorl of flower segmentation , 2010, Image Vis. Comput..

[14]  D. Sagi,et al.  Gabor filters as texture discriminator , 1989, Biological Cybernetics.

[15]  Sim Heng Ong,et al.  Integrating machine learning with region-based active contour models in medical image segmentation , 2017, J. Vis. Commun. Image Represent..

[16]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[17]  Maoguo Gong,et al.  An efficient bi-convex fuzzy variational image segmentation method , 2015, Inf. Sci..

[18]  D. S. Guru,et al.  Textural features in flower classification , 2011, Math. Comput. Model..

[19]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[20]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[21]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[22]  Bahadir Karasulu,et al.  An approach based on simulated annealing to optimize the performance of extraction of the flower region using mean-shift segmentation , 2013, Appl. Soft Comput..

[23]  Yogesh Rathi,et al.  Graph Cut Segmentation with Nonlinear Shape Priors , 2007, 2007 IEEE International Conference on Image Processing.

[24]  Ioannis Pratikakis,et al.  Unsupervised Spectral Mesh Segmentation Driven by Heterogeneous Graphs , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Wooi-Nee Tan,et al.  Enhanced “GrabCut” tool with blob analysis in segmentation of blooming flower images , 2013, 2013 10th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[26]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[27]  Paul F. Whelan,et al.  Image segmentation based on the integration of colour-texture descriptors - A review , 2011, Pattern Recognit..

[28]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[29]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[30]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Dengsheng Zhang Color Feature Extraction , 2019 .

[32]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[33]  Wagner Coelho A. Pereira,et al.  Analysis of Co-Occurrence Texture Statistics as a Function of Gray-Level Quantization for Classifying Breast Ultrasound , 2012, IEEE Transactions on Medical Imaging.

[34]  P. V. V. Kishore,et al.  Double Technique for Improving Ultrasound Medical Images , 2016 .

[35]  Hui-Fuang Ng Automatic thresholding for defect detection , 2006, Pattern Recognit. Lett..

[36]  Abdulrahman Al-Janobi,et al.  Performance evaluation of cross-diagonal texture matrix method of texture analysis , 2001, Pattern Recognit..

[37]  Feng Zhao,et al.  Optimal-selection-based suppressed fuzzy c-means clustering algorithm with self-tuning non local spatial information for image segmentation , 2014, Expert Syst. Appl..

[38]  Andrew Zisserman,et al.  A Visual Vocabulary for Flower Classification , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[39]  Ezzeddine Zagrouba,et al.  Model-based graph-cut method for automatic flower segmentation with spatial constraints , 2014, Image Vis. Comput..

[40]  Yong Gan,et al.  An active contour model based on fused texture features for image segmentation , 2015, Neurocomputing.

[41]  D. S. Guru,et al.  Retrieval of Flower Based on Sketches , 2015 .

[42]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[43]  Bilwaj Gaonkar,et al.  Deep learning in the small sample size setting: cascaded feed forward neural networks for medical image segmentation , 2016, SPIE Medical Imaging.

[44]  G. Glatting,et al.  Comparison of five cluster validity indices performance in brain [18F]FET‐PET image segmentation using k‐means , 2017, Medical physics.

[45]  Tzu-Hsiang Hsu,et al.  An interactive flower image recognition system , 2010, Multimedia Tools and Applications.

[46]  Lei Wei,et al.  Texture aware image segmentation using graph cuts and active contours , 2013, Pattern Recognit..

[47]  Derek Hoiem,et al.  Learning CRFs Using Graph Cuts , 2008, ECCV.