Fast global SA(2, R) shape registration based on invertible invariant descriptor

Abstract Here, we intend to introduce a fast and non-rigid global registration for simple planar closed curves relatively to the planar Special Affine group SA(2,R). In previous work, Ghorbel (1998) has been introduced a complete and stable set of invariant for simple closed planar curves which is invariant jointly under its original parameterization and special planar affine transformations. Such property allows us a robust reconstruction of the considered object up to a special affine transformation. In this paper, several numerical difficulties of the computation of the proposed reconstruction are considered. The robustness of this inverse problem with respect to noise and reasonable deformations of non-rigid shape is demonstrated experimentally. The proposed new registration is based, on the one hand, on the shift theorem relating to the group SA(2,R) and, on the other hand, on the invertibility of the set of invariant. Since this shift theorem allows the extraction of a pose parameters exciting between reference and target objects. The low algorithmic complexity is due to the fact that the computation of the inverse descriptors are based essentially on the Fast Fourier Transformation (FFT) algorithm. Experiments are conducted on different known datasets such as MPEG-7, MCD, Kimia-99, Kimia216, ETH-80 and Swedish leaf datasets. Promising results on the sense of shape retrieval and shape recognition rates will also be demonstrated.

[1]  Hui Wei,et al.  A novel method for 2D nonrigid partial shape matching , 2018, Neurocomputing.

[2]  Jinhee Chun,et al.  Distance interior ratio: A new shape signature for 2D shape retrieval , 2016, Pattern Recognit. Lett..

[3]  Stefan Roth,et al.  Efficient Multi-cue Scene Segmentation , 2013, GCPR.

[4]  Noel E. O'Connor,et al.  A multiscale representation method for nonrigid shapes with a single closed contour , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Luc Van Gool,et al.  Recognition of planar shapes under affine distortion , 2005, International Journal of Computer Vision.

[6]  Faouzi Ghorbel Towards a unitary formulation for invariant image description: application to image coding , 1998, Ann. des Télécommunications.

[7]  Nasser Kehtarnavaz,et al.  An affine invariant curve matching method for photo-identification of marine mammals , 2005, Pattern Recognit..

[8]  Chun-Hsiung Fang,et al.  Synthesized affine invariant function for 2D shape recognition , 2007, Pattern Recognit..

[9]  Zhuowen Tu,et al.  Learning Context-Sensitive Shape Similarity by Graph Transduction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yun Yang,et al.  AFFINE MAURER–CARTAN INVARIANTS AND THEIR APPLICATIONS IN SELF-AFFINE FRACTALS , 2018, Fractals.

[11]  Wei Jia,et al.  Multiscale Distance Matrix for Fast Plant Leaf Recognition , 2012, IEEE Transactions on Image Processing.

[12]  Anuj Srivastava,et al.  Affine-invariant, elastic shape analysis of planar contours , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Saeid Belkasim,et al.  Farthest point distance: A new shape signature for Fourier descriptors , 2009, Signal Process. Image Commun..

[14]  Huili Liu Curves in Affine and Semi-Euclidean Spaces , 2014 .

[15]  Mark Moyou,et al.  A Grassmannian Graph Approach to Affine Invariant Feature Matching , 2016, IEEE Transactions on Image Processing.

[16]  Josef Kittler,et al.  An unification of Inner Distance Shape Context and Local Binary Pattern for Shape Representation and Classification , 2015, PerMIn '15.

[17]  Ron Kimmel,et al.  Affine Invariant Geometry for Non-rigid Shapes , 2014, International Journal of Computer Vision.

[18]  Jianyu Yang,et al.  Invariant multi-scale descriptor for shape representation, matching and retrieval , 2016, Comput. Vis. Image Underst..

[19]  John S. Zelek,et al.  Local Feature Matching For Face Recognition , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[20]  Ilaria Bartolini,et al.  WARP: accurate retrieval of shapes using phase of Fourier descriptors and time warping distance , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Nikos Paragios,et al.  Shape registration in implicit spaces using information theory and free form deformations , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  David Cyganski,et al.  A linear signal decomposition approach to affine invariant contour identification , 1995, Pattern Recognit..

[23]  Longin Jan Latecki,et al.  Shape Matching for Robot Mapping , 2004, PRICAI.

[24]  Gérard G. Medioni,et al.  A graph-based global registration for 2D mosaics , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[25]  Xiaojun Wu,et al.  Multi-scale contour flexibility shape signature for Fourier descriptor , 2015, J. Vis. Commun. Image Represent..

[26]  Naif Alajlan,et al.  Shape retrieval using triangle-area representation and dynamic space warping , 2007, Pattern Recognit..

[27]  Guojun Lu,et al.  Study and evaluation of different Fourier methods for image retrieval , 2005, Image Vis. Comput..

[28]  Guojun Lu,et al.  A Comparative Study of Fourier Descriptors for Shape Representation and Retrieval , 2002 .

[29]  Faouzi Ghorbel,et al.  An almost complete curvature scale space representation: Euclidean case , 2019, Signal Process. Image Commun..

[30]  Nikos Paragios,et al.  Non-rigid registration using distance functions , 2003, Comput. Vis. Image Underst..

[31]  Yeung Sam Hung,et al.  Affine-invariant shape matching and recognition under partial occlusion , 2010, 2010 IEEE International Conference on Image Processing.

[32]  Liming Zhang,et al.  A new scheme for extraction of affine invariant descriptor and affine motion estimation based on independent component analysis , 2005, Pattern Recognit. Lett..

[33]  Wei Wang,et al.  A Robust Affine Invariant Point Extraction Algorithm for Image Registration , 2017, 2017 10th International Symposium on Computational Intelligence and Design (ISCID).

[34]  Joshua D. Schwartz,et al.  Hierarchical Matching of Deformable Shapes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Wesley E. Snyder,et al.  Application of Affine-Invariant Fourier Descriptors to Recognition of 3-D Objects , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Yang Song,et al.  Fourier Transform to Group Feature on Generated Coarser Contours for Fast 2D Shape Matching , 2020, IEEE Access.

[37]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[38]  Oskar Söderkvist,et al.  Computer Vision Classification of Leaves from Swedish Trees , 2001 .

[39]  Philippe Carré,et al.  Spectral Graph Wavelet based Nonrigid Image Registration , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[40]  Josef Kittler,et al.  Curvature scale space image in shape similarity retrieval , 1999, Multimedia Systems.

[41]  J Prakash,et al.  Medical Image Analysis of Image Segmentation and Registration Techniques , 2016 .

[42]  Hui Wei,et al.  Multiscale Triangular Centroid Distance for Shape-Based Plant Leaf Recognition , 2016, ECAI.

[43]  Emir Sokic,et al.  Novel fourier descriptor based on complex coordinates shape signature , 2014, 2014 12th International Workshop on Content-Based Multimedia Indexing (CBMI).

[44]  Yuehua Cheng,et al.  A curvature salience descriptor for full and partial shape matching , 2018, Multimedia Tools and Applications.

[45]  B. S. Manjunath,et al.  Affine-invariant curve matching , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[46]  Xiaojun Wu,et al.  A novel contour descriptor for 2D shape matching and its application to image retrieval , 2011, Image Vis. Comput..

[47]  Yunyi Yan,et al.  A Weighted Fourier and Wavelet-Like Shape Descriptor Based on IDSC for Object Recognition , 2019, Symmetry.

[48]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[49]  K. Nomizu,et al.  Affine Differential Geometry: Geometry of Affine Immersions , 2008 .

[50]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Trans. Syst. Man Cybern..

[51]  Junwei Wang,et al.  Shape matching and classification using height functions , 2012, Pattern Recognit. Lett..

[52]  Cong Zhao,et al.  Plant identification using leaf shapes - A pattern counting approach , 2015, Pattern Recognit..

[53]  M. Spivak A comprehensive introduction to differential geometry , 1979 .

[54]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[55]  Yun Yang,et al.  Moving Frames and Differential Invariants on Fully Affine Planar Curves , 2020 .

[56]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Ulrich Eckhardt,et al.  Shape descriptors for non-rigid shapes with a single closed contour , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[58]  James M. Rehg,et al.  CENTRIST: A Visual Descriptor for Scene Categorization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Andrew Zisserman,et al.  A Boundary-Fragment-Model for Object Detection , 2006, ECCV.

[60]  Isaac Weiss,et al.  Geometric invariants and object recognition , 1993, International Journal of Computer 11263on.

[61]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[62]  Na Hu Centroaffine space curves with constant curvatures and homogeneous surfaces , 2011 .

[63]  Julie Delon,et al.  Robust estimation of local affine maps and its applications to image matching , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[64]  Peter J. Olver,et al.  Modern Developments in the Theory and Applications of Moving Frames , 2015 .

[65]  Mohamed S. Kamel,et al.  Wavelet approximation-based affine invariant shape representation functions , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  Saeid Belkasim,et al.  Invariant curvature-based Fourier shape descriptors , 2012, J. Vis. Commun. Image Represent..

[67]  F. Ghorbel,et al.  Global planar rigid motion estimation applied to object-oriented coding , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[68]  David Cyganski,et al.  Object Identification And Orientation Estimation From Contours Based On An Affine Invariant Curvature , 1988, Other Conferences.

[69]  Slimane Larabi,et al.  Shape retrieval through normalized B-splines curves , 2017, Multimedia Tools and Applications.

[70]  Sadegh Abbasi,et al.  Affine Curvature Scale Space with Affine Length Parametrisation , 2014, Pattern Analysis & Applications.

[71]  Euripides G. M. Petrakis,et al.  Matching and Retrieval of Distorted and Occluded Shapes Using Dynamic Programming , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Xiaoou Tang,et al.  2D Shape Matching by Contour Flexibility , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  Bin Wang Shape retrieval using combined Fourier features , 2011 .

[74]  Bernt Schiele,et al.  Analyzing appearance and contour based methods for object categorization , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[75]  Wageeh W. Boles,et al.  An application of wavelet-based affine-invariant representation , 1995, Pattern Recognit. Lett..

[76]  Faouzi Ghorbel,et al.  An invariant similarity registration algorithm based on the Analytical Fourier-Mellin Transform , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[77]  Peter J. Olver,et al.  Moving frames and differential invariants in centro-affine geometry , 2010 .

[78]  Qian Yu,et al.  Multiscale Fourier descriptor based on triangular features for shape retrieval , 2019, Signal Process. Image Commun..

[79]  Guy Cohen,et al.  Decoupled Linear Estimation of Affine Geometric Deformations and Nonlinear Intensity Transformations of Images , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Haibin Ling,et al.  Shape Classification Using the Inner-Distance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.