Shape Representation and Classification through Pattern Spectrum and Local Binary Pattern -- A Decision Level Fusion Approach

In this paper, we present a decision level fused local Morphological Pattern Spectrum (PS) and Local Binary Pattern (LBP) approach for an efficient shape representation and classification. This method makes use of Earth Movers Distance (EMD) as the measure in feature matching and shape retrieval process. The proposed approach has three major phases: Feature Extraction, Construction of hybrid spectrum knowledge base and Classification. In the first phase, feature extraction of the shape is done using pattern spectrum and local binary pattern method. In the second phase, the histograms of both pattern spectrum and local binary pattern are fused and stored in the knowledge base. In the third phase, the comparison and matching of the features, which are represented in the form of histograms, is done using Earth Movers Distance (EMD) as metric. The top-n shapes are retrieved for each query shape. The accuracy is tested by means of standard Bulls eye score method. The experiments are conducted on publicly available shape datasets like Kimia-99, Kimia-216 and MPEG-7. The comparative study is also provided with the well known approaches to exhibit the retrieval accuracy of the proposed approach.

[1]  Philip N. Klein,et al.  On Aligning Curves , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Wenyu Liu,et al.  Skeletonization using SSM of the Distance Transform , 2007, 2007 IEEE International Conference on Image Processing.

[3]  H. Blum Biological shape and visual science (part I) , 1973 .

[4]  G. Matheron Random Sets and Integral Geometry , 1976 .

[5]  Mubarak Shah,et al.  Shape matching and modeling using skeletal context , 2008, Pattern Recognit..

[6]  Kaleem Siddiqi,et al.  Matching Hierarchical Structures Using Association Graphs , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Zhuowen Tu,et al.  Shape Matching and Recognition - Using Generative Models and Informative Features , 2004, ECCV.

[8]  Longin Jan Latecki,et al.  Path Similarity Skeleton Graph Matching , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[10]  Benjamin B. Kimia,et al.  Curves vs skeletons in object recognition , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[11]  Kaleem Siddiqi,et al.  A shock grammar for recognition , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Petros Maragos,et al.  Pattern Spectrum and Multiscale Shape Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  M. Fatih Demirci,et al.  Skeletal Shape Abstraction from Examples , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  M. Fatih Demirci,et al.  Object Recognition as Many-to-Many Feature Matching , 2006, International Journal of Computer Vision.

[15]  LateckiLongin Jan,et al.  Shape Similarity Measure Based on Correspondence of Visual Parts , 2000 .

[16]  Kaleem Siddiqi,et al.  Shapes, shocks and wiggles , 1999, Image Vis. Comput..

[17]  Hongyuan Wang,et al.  Shape clustering: Common structure discovery , 2013, Pattern Recognit..

[18]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[20]  Sven J. Dickinson,et al.  From skeletons to bone graphs: Medial abstraction for object recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Philip N. Klein,et al.  Recognition of Shapes by Editing Shock Graphs , 2001, ICCV.

[23]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[24]  Haibin Ling,et al.  Shape Classification Using the Inner-Distance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Ulrich Eckhardt,et al.  Shape descriptors for non-rigid shapes with a single closed contour , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[26]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[27]  Xiaojun Wu,et al.  A novel contour descriptor for 2D shape matching and its application to image retrieval , 2011, Image Vis. Comput..

[28]  Junwei Wang,et al.  Shape matching and classification using height functions , 2012, Pattern Recognit. Lett..

[29]  Josef Kittler,et al.  Efficient and Robust Retrieval by Shape Content through Curvature Scale Space , 1998, Image Databases and Multi-Media Search.