Exploring generalized shape analysis by topological representations

A generalized shape analysis based on persistent homology.More powerful discrimination by using multiple functions.The theoretical guarantee of integrating multiple functions.Effective combination of different functions by exploiting metric learning.Experimental results show its potentials in applications. One of the most common properties of various data in pattern recognition is the shape, and the shape matters. However, the shape can appear with uncertain appearances, e.g., the shapes of a person in different poses. We realize that the most fundamental feature of any shape is the number of connected components, the number of holes and its higher dimensional counterparts. These are what we call topological invariants. This is the place where topology comes into play for pattern recognition. Persistent homology, one of the most powerful tools in algebraic topology, is proposed to compute these topological invariants at different resolutions. The proposed method, by firstly transferring the given data into a topological graph representation, i.e., the simplicial complex, can assemble discrete points into a global structure. Then by integrating with multiple filtrations and metric learning, both the global structure and different local parts can be taken into account at the same time. We test the proposed method in 2D shape classification, 2.5D gait identification and 3D facial expression recognition. Experimental results demonstrate the effectiveness of this generalized shape analysis method and show its potentials in different applications. Moreover, we provide a new insight for the generalized shape analysis.

[1]  Herbert Edelsbrunner,et al.  Topological persistence and simplification , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[2]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Afra Zomorodian,et al.  Computing Persistent Homology , 2005, Discret. Comput. Geom..

[4]  H. Edelsbrunner,et al.  Persistent Homology — a Survey , 2022 .

[5]  Claudia Landi,et al.  Persistent homology and partial similarity of shapes , 2012, Pattern Recognit. Lett..

[6]  Qinghua Hu,et al.  Multi-granularity distance metric learning via neighborhood granule margin maximization , 2014, Inf. Sci..

[7]  Junwei Wang,et al.  Shape matching and classification using height functions , 2012, Pattern Recognit. Lett..

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Vin de Silva,et al.  On the Local Behavior of Spaces of Natural Images , 2007, International Journal of Computer Vision.

[10]  Naif Alajlan,et al.  Shape retrieval using triangle-area representation and dynamic space warping , 2007, Pattern Recognit..

[11]  Rocío González-Díaz,et al.  Human Gait Identification Using Persistent Homology , 2012, CIARP.

[12]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rocío González-Díaz,et al.  Towards Minimal Barcodes , 2013, GbRPR.

[14]  Li Wei,et al.  SAXually Explicit Images: Finding Unusual Shapes , 2006, Sixth International Conference on Data Mining (ICDM'06).

[15]  Alexander M. Bronstein,et al.  Quantifying 3D Shape Similarity Using Maps: Recent Trends, Applications and Perspectives , 2014, Eurographics.

[16]  David Zhang,et al.  Human Gait Recognition via Sparse Discriminant Projection Learning , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Yiying Tong,et al.  FaceWarehouse: A 3D Facial Expression Database for Visual Computing , 2014, IEEE Transactions on Visualization and Computer Graphics.

[18]  Chao Chen,et al.  Algebraic topology for computer vision , 2009 .

[19]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[20]  Herbert Edelsbrunner,et al.  Topological Persistence and Simplification , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[21]  Jean-Daniel Boissonnat,et al.  Complexity of the delaunay triangulation of points on surfaces the smooth case , 2003, SCG '03.

[22]  Tieniu Tan,et al.  Feature Coding in Image Classification: A Comprehensive Study , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Ruzena Bajcsy,et al.  Local Occlusion Detection under Deformations Using Topological Invariants , 2010, ECCV.

[24]  Mikael Vejdemo-Johansson,et al.  javaPlex: A Research Software Package for Persistent (Co)Homology , 2014, ICMS.

[25]  Eamonn J. Keogh,et al.  Manifold Clustering of Shapes , 2006, Sixth International Conference on Data Mining (ICDM'06).

[26]  R. Ghrist Barcodes: The persistent topology of data , 2007 .

[27]  Leonidas J. Guibas,et al.  A Barcode Shape Descriptor for Curve Point Cloud Data , 2004, PBG.

[28]  Ali Shokoufandeh,et al.  Indexing hierarchical structures using graph spectra , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[30]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[31]  Tieniu Tan,et al.  A Study on Gait-Based Gender Classification , 2009, IEEE Transactions on Image Processing.

[32]  Ghassan Hamarneh,et al.  A Survey on Shape Correspondence , 2011, Comput. Graph. Forum.

[33]  Cordelia Schmid,et al.  Is that you? Metric learning approaches for face identification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[34]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[35]  Zhuowen Tu,et al.  Learning Context-Sensitive Shape Similarity by Graph Transduction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[37]  Anuj Srivastava,et al.  Shape Analysis of Elastic Curves in Euclidean Spaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).