PI-Net: A Deep Learning Approach to Extract Topological Persistence Images

Topological features such as persistence diagrams and their functional approximations like persistence images (PIs) have been showing substantial promise for machine learning and computer vision applications. This is greatly attributed to the robustness topological representations provide against different types of physical nuisance variables seen in real-world data, such as view-point, illumination, and more. However, key bottlenecks to their large scale adoption are computational expenditure and difficulty incorporating them in a differentiable architecture. We take an important step in this paper to mitigate these bottlenecks by proposing a novel one-step approach to generate PIs directly from the input data. We design two separate convolutional neural network architectures, one designed to take in multi-variate time series signals as input and another that accepts multi-channel images as input. We call these networks Signal PI-Net and Image PI- Net respectively. To the best of our knowledge, we are the first to propose the use of deep learning for computing topological features directly from data. We explore the use of the proposed PI-Net architectures on two applications: human activity recognition using tri-axial accelerometer sensor data and image classification. We demonstrate the ease of fusion of PIs in supervised deep learning architectures and speed up of several orders of magnitude for extracting PIs from data. Our code is available at https://github.com/anirudhsom/PI-Net.

[1]  Pavan K. Turaga,et al.  A statistical estimation framework for energy expenditure of physical activities from a wrist-worn accelerometer , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  D. Ringach,et al.  Topological analysis of population activity in visual cortex. , 2008, Journal of vision.

[3]  Moo K. Chung,et al.  Persistence Diagrams of Cortical Surface Data , 2009, IPMI.

[4]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[5]  Ulrich Bauer,et al.  Distributed Computation of Persistent Homology , 2014, ALENEX.

[6]  Abhinav Gupta,et al.  Designing deep networks for surface normal estimation , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Karsten M. Borgwardt,et al.  Neural Persistence: A Complexity Measure for Deep Neural Networks Using Algebraic Topology , 2018, ICLR.

[8]  Jose A. Perea,et al.  (Quasi)Periodicity Quantification in Video Data, Using Topology , 2017, SIAM J. Imaging Sci..

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Jose A. Perea,et al.  Sliding Windows and Persistence: An Application of Topological Methods to Signal Analysis , 2013, Found. Comput. Math..

[11]  Rocío González-Díaz,et al.  An entropy-based persistence barcode , 2015, Pattern Recognit..

[12]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[13]  Leonidas J. Guibas,et al.  Image webs: Computing and exploiting connectivity in image collections , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Maks Ovsjanikov,et al.  Persistence-Based Structural Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[16]  Ulrich Bauer,et al.  A stable multi-scale kernel for topological machine learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[18]  Rob Fergus,et al.  Depth Map Prediction from a Single Image using a Multi-Scale Deep Network , 2014, NIPS.

[19]  Peter Bubenik,et al.  Statistical topological data analysis using persistence landscapes , 2012, J. Mach. Learn. Res..

[20]  Henry Adams,et al.  Persistence Images: A Stable Vector Representation of Persistent Homology , 2015, J. Mach. Learn. Res..

[21]  Peter Bubenik,et al.  Statistical Inferences from the Topology of Complex Networks , 2016 .

[22]  Herbert Edelsbrunner,et al.  Computational Topology - an Introduction , 2009 .

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  Massimo Ferri,et al.  Why Topology for Machine Learning and Knowledge Extraction? , 2018, Mach. Learn. Knowl. Extr..

[25]  Andreas Uhl,et al.  Deep Learning with Topological Signatures , 2017, NIPS.

[26]  Ravi Kiran Sarvadevabhatla,et al.  A Taxonomy of Deep Convolutional Neural Nets for Computer Vision , 2016, Front. Robot. AI.

[27]  Pavan Turaga,et al.  Topological Descriptors for Parkinson’s Disease Classification and Regression Analysis , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Kush R. Varshney,et al.  Topological Data Analysis of Decision Boundaries with Application to Model Selection , 2019, ICML.

[30]  Karthikeyan Natesan Ramamurthy,et al.  Perturbation Robust Representations of Topological Persistence Diagrams , 2018, ECCV.

[31]  Moo K. Chung,et al.  Topology-Based Kernels With Application to Inference Problems in Alzheimer's Disease , 2011, IEEE Transactions on Medical Imaging.

[32]  Yuri Dabaghian,et al.  A Topological Paradigm for Hippocampal Spatial Map Formation Using Persistent Homology , 2012, PLoS Comput. Biol..

[33]  Karthikeyan Natesan Ramamurthy,et al.  Persistent homology of attractors for action recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[34]  Guo-Wei Wei,et al.  TopologyNet: Topology based deep convolutional and multi-task neural networks for biomolecular property predictions , 2017, PLoS Comput. Biol..

[35]  Tamal K. Dey,et al.  Improved Image Classification using Topological Persistence , 2017, VMV.

[36]  Herbert Edelsbrunner,et al.  Topological persistence and simplification , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[37]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Mikael Vejdemo-Johansson,et al.  javaPlex: A Research Software Package for Persistent (Co)Homology , 2014, ICMS.

[39]  Gard Spreemann,et al.  Topology of Learning in Artificial Neural Networks , 2019, ArXiv.

[40]  Karthikeyan Natesan Ramamurthy,et al.  A Riemannian Framework for Statistical Analysis of Topological Persistence Diagrams , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[41]  Trevor Darrell,et al.  Part-Based R-CNNs for Fine-Grained Category Detection , 2014, ECCV.

[42]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[43]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Trevor Darrell,et al.  PANDA: Pose Aligned Networks for Deep Attribute Modeling , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[46]  Andrew Y. Ng,et al.  Reading Digits in Natural Images with Unsupervised Feature Learning , 2011 .

[47]  Martial Hebert,et al.  Dense Optical Flow Prediction from a Static Image , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[48]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[49]  Mi Zhang,et al.  USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors , 2012, UbiComp.

[50]  Rickard Brüel Gabrielsson,et al.  Exposition and Interpretation of the Topology of Neural Networks , 2018, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[51]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[52]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Adam Watkins,et al.  Feature-aided multiple hypothesis tracking using topological and statistical behavior classifiers , 2015, Defense + Security Symposium.