Review of shape representation and description techniques

More and more images have been generated in digital form around the world. There is a growing interest in 1nding images in large collections or from remote databases. In order to 1nd an image, the image has to be described or represented by certain features. Shape is an important visual feature of an image. Searching for images using shape features has attracted much attention. There are many shape representation anddescription techniques in the literature. In this paper, we classify and review these important techniques. We examine implementation procedures for each technique and discuss its advantages and disadvantages. Some recent research results are also included and discussed in this paper. Finally, we identify some promising techniques for image retrieval according to standard principles.

[1]  Matti Pietikäinen,et al.  An Experimental Comparison of Autoregressive and Fourier-Based Descriptors in 2D Shape Classification , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Manohar Das,et al.  A Bivariate Autoregressive Technique for Analysis and Classification of Planar Shapes , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Richard J. Prokop,et al.  A survey of moment-based techniques for unoccluded object representation and recognition , 1992, CVGIP Graph. Model. Image Process..

[5]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[6]  Guojun Lu,et al.  A Comparison of Shape Retrieval Using Fourier Descriptors and Short-Time Fourier Descriptors , 2001, IEEE Pacific Rim Conference on Multimedia.

[7]  Adam Krzyzak,et al.  Reconstruction of two-dimensional patterns from Fourier descriptors , 2005, Machine Vision and Applications.

[8]  M. Teague.  Image analysis via the general theory of moments , 1980 .

[9]  William I. Grosky,et al.  Index-based object recognition in pictorial data management , 1990, Comput. Vis. Graph. Image Process..

[10]  David B. Cooper,et al.  Recognition and positioning of rigid objects using algebraic moment invariants , 1991, Optics & Photonics.

[11]  Whoi-Yul Kim,et al.  A region-based shape descriptor using Zernike moments , 2000, Signal Process. Image Commun..

[12]  Josef Kittler,et al.  Enhancing CSS-based shape retrieval for objects with shallow concavities , 2000, Image Vis. Comput..

[13]  Josef Kittler,et al.  Robust and Efficient Shape Indexing through Curvature Scale Space , 1996, BMVC.

[14]  Roland T. Chin,et al.  On image analysis by the methods of moments , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  B. Morse.  Computation of object cores from grey-level images , 1996 .

[16]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[17]  Ian T. Young,et al.  An Analysis Technique for Biological Shape. I , 1974, Inf. Control..

[18]  Josef Kittler,et al.  Efficient and Robust Retrieval by Shape Content through Curvature Scale Space , 1998, Image Databases and Multi-Media Search.

[19]  Michael G. Thomason,et al.  Syntactic Methods in Pattern Recognition , 1982 .

[20]  L. N. Kanal,et al.  A Bivariate Autoregressive Modeling Technique for Analysis and Classification of Planar Shapes , 1990 .

[21]  O. Robert Mitchell.  Global And Partial Shape Discrimination For Computer Vision , 1983, Optics & Photonics.

[22]  Sang Uk Lee,et al.  Recognition of 2D Object Contours Using Starting-Point-Independent Wavelet Coefficient Matching , 1998, J. Vis. Commun. Image Represent..

[23]  Francisco J. Sánchez-Marín.  Automatic recognition of biological shapes with and without representations of shape , 2000, Artif. Intell. Medicine.

[24]  Filson H. Glanz,et al.  An Autoregressive Model Approach to Two-Dimensional Shape Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Majid Ahmadi,et al.  Pattern recognition with moment invariants: A comparative study and new results , 1991, Pattern Recognit..

[26]  J. IIVARINENHelsinki.  Efficiency of Simple Shape Descriptors , 1997 .

[27]  A. Ardeshir Goshtasby,et al.  Description and Discrimination of Planar Shapes Using Shape Matrices , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Alberto Del Bimbo,et al.  Visual Image Retrieval by Elastic Matching of User Sketches , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Rama Chellappa,et al.  Stochastic models for closed boundary analysis: Representation and reconstruction , 1981, IEEE Trans. Inf. Theory.

[30]  Chung-Lin Huang,et al.  A content-based image retrieval system , 1998, Image Vis. Comput..

[31]  Arnold W. M. Smeulders,et al.  Image Databases and Multi-Media Search , 1998, Image Databases and Multi-Media Search.

[32]  Guojun Lu,et al.  Shape-based image retrieval using generic Fourier descriptor , 2002, Signal Process. Image Commun..

[33]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[34]  Guojun Lu,et al.  Generic Fourier descriptor for shape-based image retrieval , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[35]  Theodosios Pavlidis,et al.  Algorithms for Shape Analysis of Contours and Waveforms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Yang He,et al.  2-D Shape Classification Using Hidden Markov Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Hooshang Hemami,et al.  Identification of Three-Dimensional Objects Using Fourier Descriptors of the Boundary Curve , 1974, IEEE Trans. Syst. Man Cybern..

[39]  Chun-Shin Lin,et al.  New forms of shape invariants from elliptic fourier descriptors , 1987, Pattern Recognit..

[40]  Ehud Rivlin,et al.  Invariant-Based Shape Retrieval in Pictorial Databases , 1998, Comput. Vis. Image Underst..

[41]  Guojun Lu,et al.  Region-based shape representation and similarity measure suitable for content-based image retrieval , 1999, Multimedia Systems.

[42]  Omid M. Omidvar.  Progress in neural networks , 1991 .

[43]  Aljoscha Smolic,et al.  A set of visual feature descriptors and their combination in a low-level description scheme , 2000, Signal Process. Image Commun..

[44]  Daniel P. Huttenlocher,et al.  A multi-resolution technique for comparing images using the Hausdorff distance , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Stan Z. Li,et al.  Matching: Invariant to translations, rotations and scale changes , 1992, Pattern Recognit..

[46]  Jitendra Malik,et al.  Matching Shapes , 2001, ICCV.

[47]  Benjamin Van Roy,et al.  Solving Data Mining Problems Through Pattern Recognition , 1997 .

[48]  Ari Visa,et al.  Shape recognition of irregular objects , 1996, Other Conferences.

[49]  Ching Y. Suen,et al.  Discrimination of planar shapes using shape matrices , 1989, IEEE Trans. Syst. Man Cybern..

[50]  Hae-Kwang Kim,et al.  Region-based shape descriptor invariant to rotation, scale and translation , 2000, Signal Process. Image Commun..

[51]  Mohan S. Kankanhalli,et al.  Shape Measures for Content Based Image Retrieval: A Comparison , 1997, Inf. Process. Manag..

[52]  Gösta H. Granlund,et al.  Fourier Preprocessing for Hand Print Character Recognition , 1972, IEEE Transactions on Computers.

[53]  William I. Grosky,et al.  A pictorial index mechanism for model-based matching , 1989, [1989] Proceedings. Fifth International Conference on Data Engineering.

[54]  Miroslaw Pawlak,et al.  On Image Analysis by Moments , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Rama Chellappa,et al.  Classification of Partial 2-D Shapes Using Fourier Descriptors , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[57]  D. Eberly.  Geometric methods for analysis of ridges in n-dimensional images , 1994 .

[58]  Guojun Lu,et al.  A Comparative Study of Fourier Descriptors for Shape Representation and Retrieval , 2002 .

[59]  Wageeh Boles,et al.  Recognition of 2D object contours using the wavelet transform zero-crossing representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  J. Park,et al.  Recognition of shapes by statistical modeling of centroidal profile , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[61]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[62]  Swapan K. Parui,et al.  How to discriminate shapes using the shape vector , 1986, Pattern Recognit. Lett..

[63]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[64]  Mohamed Daoudi,et al.  Visual Image Retrieval by Multiscale Description of User Sketches , 2000, J. Vis. Lang. Comput..

[65]  Brian Scassellati,et al.  Retrieving images by 2D shape: a comparison of computation methods with human perceptual judgments , 1994, Electronic Imaging.

[66]  Chao Lu,et al.  Shape representation by Gabor expansion , 1990, Other Conferences.

[67]  E.E. Pissaloux,et al.  Image Processing , 1994, Proceedings. Second Euromicro Workshop on Parallel and Distributed Processing.

[68]  Farzin Mokhtarian,et al.  Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Whoi-Yul Kim,et al.  Content-based trademark retrieval system using a visually salient feature , 1998, Image Vis. Comput..

[70]  Dmitry Chetverikov,et al.  Matching for Shape Defect Detection , 1999, CAIP.

[71]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  R. Brubaker.  Models for the perception of speech and visual form: Weiant Wathen-Dunn, ed.: Cambridge, Mass., The M.I.T. Press, I–X, 470 pages , 1968 .

[73]  Takio Kurita,et al.  Complex Autoregressive Model for Shape Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Josef Kittler,et al.  Curvature scale space image in shape similarity retrieval , 1999, Multimedia Systems.

[75]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[76]  William Rucklidge,et al.  Efficiently Locating Objects Using the Hausdorff Distance , 1997, International Journal of Computer Vision.

[77]  John K. Tsotsos,et al.  Shape Representation and Recognition from Multiscale Curvature , 1997, Comput. Vis. Image Underst..

[78]  Toshikazu Kato,et al.  Query by Visual Example - Content based Image Retrieval , 1992, EDBT.

[79]  Dengsheng Zhang.  Image retrieval based on shape , 2002 .

[80]  Thomas S. Huang,et al.  A Modified Fourier Descriptor for Shape Matching in MARS , 1998, Image Databases and Multi-Media Search.

[81]  Rajiv Mehrotra,et al.  Similar-Shape Retrieval in Shape Data Management , 1995, Computer.

[82]  Rama Chellappa,et al.  Fourier Coding of Image Boundaries , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[83]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[84]  Cyrus Shahabi,et al.  Image retrieval by shape: a comparative study , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[85]  Terry Caelli,et al.  Invariance Signatures: Characterizing Contours by Their Departures from Invariance , 2000, Comput. Vis. Image Underst..

[86]  Guojun Lu,et al.  Enhanced Generic Fourier Descriptors for object-based image retrieval , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[87]  Bernd Jähne,et al.  Digital Image Processing: Concepts, Algorithms, and Scientific Applications , 1991 .

[88]  Sharad Mehrotra,et al.  Similar shape retrieval in MARS , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[89]  Alberto Del Bimbo,et al.  Retrieval by Shape Similarity with Perceptual Distance and Effective Indexing , 2000, IEEE Trans. Multim..

[90]  William I. Grosky,et al.  A pictorial index mechanism for model-based matching , 1992, Data Knowl. Eng..

[91]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[92]  R.M. McElhaney,et al.  Algorithms for graphics and image processing , 1983, Proceedings of the IEEE.

[93]  Wesley E. Snyder,et al.  Application of Affine-Invariant Fourier Descriptors to Recognition of 3-D Objects , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[94]  Peter J. van Otterloo,et al.  A contour-oriented approach to shape analysis , 1991 .

[95]  G. Taubin,et al.  Object recognition based on moment (or algebraic) invariants , 1992 .

[96]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[97]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..