Perturbation Robust Representations of Topological Persistence Diagrams

Topological methods for data analysis present opportunities for enforcing certain invariances of broad interest in computer vision, including view-point in activity analysis, articulation in shape analysis, and measurement invariance in non-linear dynamical modeling. The increasing success of these methods is attributed to the complementary information that topology provides, as well as availability of tools for computing topological summaries such as persistence diagrams. However, persistence diagrams are multi-sets of points and hence it is not straightforward to fuse them with features used for contemporary machine learning tools like deep-nets. In this paper we present theoretically well-grounded approaches to develop novel perturbation robust topological representations, with the long-term view of making them amenable to fusion with contemporary learning architectures. We term the proposed representation as Perturbed Topological Signatures, which live on a Grassmann manifold and hence can be efficiently used in machine learning pipelines. We explore the use of the proposed descriptor on three applications: 3D shape analysis, view-invariant activity analysis, and non-linear dynamical modeling. We show favorable results in both high-level recognition performance and time-complexity when compared to other baseline methods.

[1]  Hamid Krim,et al.  Discovering the Whole by the Coarse: A topological paradigm for data analysis , 2016, IEEE Signal Processing Magazine.

[2]  Moo K. Chung,et al.  Topology-Based Kernels With Application to Inference Problems in Alzheimer's Disease , 2011, IEEE Transactions on Medical Imaging.

[3]  Yuri Dabaghian,et al.  A Topological Paradigm for Hippocampal Spatial Map Formation Using Persistent Homology , 2012, PLoS Comput. Biol..

[4]  Liwei Wang,et al.  Subspace distance analysis with application to adaptive Bayesian algorithm for face recognition , 2006, Pattern Recognit..

[5]  Marc Pollefeys,et al.  A General Framework for Motion Segmentation: Independent, Articulated, Rigid, Non-rigid, Degenerate and Non-degenerate , 2006, ECCV.

[6]  Baoshu Xu,et al.  Grassmann manifold based shape matching and retrieval under partial occlusions , 2014, Other Conferences.

[7]  Karthikeyan Natesan Ramamurthy,et al.  Persistent homology of attractors for action recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Tamal K. Dey,et al.  Improved Image Classification using Topological Persistence , 2017, VMV.

[9]  João Paulo Costeira,et al.  The Normalized Subspace Inclusion: Robust clustering of motion subspaces , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Afra Zomorodian,et al.  Fast construction of the Vietoris-Rips complex , 2010, Comput. Graph..

[11]  Roberto Manduchi,et al.  A theory of color barcodes , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[12]  Herbert Edelsbrunner,et al.  Topological Persistence and Simplification , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[13]  Clint P. George,et al.  Principled Selection of Hyperparameters in the Latent Dirichlet Allocation Model , 2017, J. Mach. Learn. Res..

[14]  Jose A. Perea,et al.  (Quasi)Periodicity Quantification in Video Data, Using Topology , 2017, SIAM J. Imaging Sci..

[15]  Paul Suetens,et al.  SHREC'10 Track: Non-rigid 3D Shape Retrieval , 2010, 3DOR@Eurographics.

[16]  Patrick Pérez,et al.  View-Independent Action Recognition from Temporal Self-Similarities , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[18]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  F. Takens Detecting strange attractors in turbulence , 1981 .

[20]  A. Yuille,et al.  Dense Scale Invariant Descriptors for Images and Surfaces , 2012 .

[21]  Afra Zomorodian,et al.  Computing Persistent Homology , 2004, SCG '04.

[22]  Mubarak Shah,et al.  Learning a Deep Model for Human Action Recognition from Novel Viewpoints , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Dmitriy Morozov,et al.  Geometry Helps to Compare Persistence Diagrams , 2016, ALENEX.

[24]  P. Absil,et al.  Riemannian Geometry of Grassmann Manifolds with a View on Algorithmic Computation , 2004 .

[25]  Pierre Vandergheynst,et al.  Geodesic Convolutional Neural Networks on Riemannian Manifolds , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[26]  Rama Chellappa,et al.  A Blur-Robust Descriptor with Applications to Face Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  J. Marron,et al.  Persistent Homology Analysis of Brain Artery Trees. , 2014, The annals of applied statistics.

[28]  Michele Volpi,et al.  Learning rotation invariant convolutional filters for texture classification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[29]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[30]  Levent Tunçel,et al.  Optimization algorithms on matrix manifolds , 2009, Math. Comput..

[31]  Liwei Wang,et al.  Further results on the subspace distance , 2007, Pattern Recognit..

[32]  David Cohen-Steiner,et al.  Stability of Persistence Diagrams , 2005, Discret. Comput. Geom..

[33]  Matthew Berger,et al.  On Time-Series Topological Data Analysis: New Data and Opportunities , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[34]  Herbert Edelsbrunner,et al.  Computational Topology - an Introduction , 2009 .

[35]  Leonidas J. Guibas,et al.  Persistence barcodes for shapes , 2004, SGP '04.

[36]  Daniel D. Lee,et al.  Grassmann discriminant analysis: a unifying view on subspace-based learning , 2008, ICML '08.

[37]  Rama Chellappa,et al.  Statistical Analysis on Manifolds and Its Applications to Video Analysis , 2010, Video Search and Mining.

[38]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[39]  Daniel Cremers,et al.  The wave kernel signature: A quantum mechanical approach to shape analysis , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[40]  Leonidas J. Guibas,et al.  SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Hongdong Li,et al.  Expanding the Family of Grassmannian Kernels: An Embedding Perspective , 2014, ECCV.

[42]  Kenji Fukumizu,et al.  Persistence weighted Gaussian kernel for topological data analysis , 2016, ICML.

[43]  Karthikeyan Natesan Ramamurthy,et al.  A Riemannian Framework for Statistical Analysis of Topological Persistence Diagrams , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[44]  Hamid Krim,et al.  Persistent Homology of Delay Embeddings and its Application to Wheeze Detection , 2014, IEEE Signal Processing Letters.

[45]  Nan Jiang,et al.  Know Your Enemy, Know Yourself: Block-Level Network Behavior Profiling and Tracking , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[46]  Adam Watkins,et al.  Feature-aided multiple hypothesis tracking using topological and statistical behavior classifiers , 2015, Defense + Security Symposium.

[47]  Lihi Zelnik-Manor,et al.  Approximate Nearest Subspace Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Frédéric Chazal,et al.  An Introduction to Topological Data Analysis: Fundamental and Practical Aspects for Data Scientists , 2017, Frontiers in Artificial Intelligence.

[49]  Mariette Yvinec,et al.  The Gudhi Library: Simplicial Complexes and Persistent Homology , 2014, ICMS.

[50]  Mubarak Shah,et al.  Chaotic Invariants for Human Action Recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[51]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[52]  Karthikeyan Natesan Ramamurthy,et al.  Multiscale evolution of attractor-shape descriptors for assessing Parkinson's disease severity , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[53]  Dan Morris,et al.  A Novel Framework for Pulse Pressure Wave Analysis Using Persistent Homology , 2015, IEEE Signal Processing Letters.

[54]  木股 雅章,et al.  SPIE's International Symposium on Optical Science, Engineering, and Instrumentation報告 , 1998 .

[55]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[56]  Dmitriy Morozov,et al.  Dualities in persistent (co)homology , 2011, ArXiv.

[57]  Rocío González-Díaz,et al.  An entropy-based persistence barcode , 2015, Pattern Recognit..

[58]  Leonidas J. Guibas,et al.  Image webs: Computing and exploiting connectivity in image collections , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[59]  S. Mukherjee,et al.  Probability measures on the space of persistence diagrams , 2011 .

[60]  Jose A. Perea,et al.  Sliding Windows and Persistence: An Application of Topological Methods to Signal Analysis , 2013, Found. Comput. Math..

[61]  Sayan Mukherjee,et al.  Fréchet Means for Distributions of Persistence Diagrams , 2012, Discrete & Computational Geometry.

[62]  Maks Ovsjanikov,et al.  Persistence-Based Structural Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[63]  Jonathan Masci,et al.  Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Andreas Uhl,et al.  Deep Learning with Topological Signatures , 2017, NIPS.

[65]  Y. Chikuse Statistics on special manifolds , 2003 .

[66]  LungShung-Yung Rapid and brief communication , 2007 .

[67]  Peter Bubenik,et al.  Statistical topological data analysis using persistence landscapes , 2012, J. Mach. Learn. Res..

[68]  Pavan K. Turaga,et al.  Shape Distributions of Nonlinear Dynamical Systems for Video-Based Inference , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Adam Watkins,et al.  Topological and statistical behavior classifiers for tracking applications , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[70]  Pavan K. Turaga,et al.  Attractor-shape descriptors for balance impairment assessment in Parkinson's disease , 2016, EMBC.

[71]  Y. Wong Differential geometry of grassmann manifolds. , 1967, Proceedings of the National Academy of Sciences of the United States of America.

[72]  David Cohen-Steiner,et al.  Lipschitz Functions Have Lp-Stable Persistence , 2010, Found. Comput. Math..

[73]  Bruce A. Draper,et al.  A flag representation for finite collections of subspaces of mixed dimensions , 2014 .

[74]  Moo K. Chung,et al.  Persistence Diagrams of Cortical Surface Data , 2009, IPMI.

[75]  Mikael Vejdemo-Johansson,et al.  javaPlex: A Research Software Package for Persistent (Co)Homology , 2014, ICMS.

[76]  D. Ringach,et al.  Topological analysis of population activity in visual cortex. , 2008, Journal of vision.

[77]  Heng Huang,et al.  Video Motion Segmentation Using New Adaptive Manifold Denoising Model , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[78]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[79]  Ulrich Bauer,et al.  Distributed Computation of Persistent Homology , 2014, ALENEX.

[80]  Michael Werman,et al.  Affine Invariance Revisited , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[81]  Lek-Heng Lim,et al.  Schubert Varieties and Distances between Subspaces of Different Dimensions , 2014, SIAM J. Matrix Anal. Appl..

[82]  Brittany Terese Fasy,et al.  Introduction to the R package TDA , 2014, ArXiv.

[83]  Anuj Srivastava,et al.  Optimal linear representations of images for object recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[84]  Henry Adams,et al.  Persistence Images: A Stable Vector Representation of Persistent Homology , 2015, J. Mach. Learn. Res..

[85]  Tom Fletcher,et al.  Terse Notes on Riemannian Geometry , 2010 .

[86]  WangLiwei,et al.  Subspace distance analysis with application to adaptive Bayesian algorithm for face recognition , 2006 .

[87]  Alexander M. Bronstein,et al.  Spectral descriptors for deformable shapes , 2011, ArXiv.

[88]  Ulrich Bauer,et al.  A stable multi-scale kernel for topological machine learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[89]  Dimitri P. Bertsekas,et al.  A new algorithm for the assignment problem , 1981, Math. Program..

[90]  Thomas Brox,et al.  Discriminative Unsupervised Feature Learning with Convolutional Neural Networks , 2014, NIPS.

[91]  Leonidas J. Guibas,et al.  Proximity of persistence modules and their diagrams , 2009, SCG '09.

[92]  Rémi Ronfard,et al.  Action Recognition from Arbitrary Views using 3D Exemplars , 2007, 2007 IEEE 11th International Conference on Computer Vision.