2D+t track detection via relative persistent homology

In this paper, we demonstrate that algebraic topology can be used to perform 2D+t object detection. After the construction of a topological complex for a 2D+t image sequence, we build a nested sequence of cell complexes on which relative persistent homology is computed. The relative homology adds to “absolute” homology the computation of classes related to the first and last frames of the sequence. By identifying 2D chains with large life spans, the most persistent classes are extracted. This allows for the identification of the interesting parts in a sequence and for the detection of the movement of objects despite continuous deformations in the image domain. The results obtained on a synthetic image and on two real biomedical images with moving vesicles recorded by a quantitative phase time‐lapse technique show the potential of this method. Comparing the method with a newly developed tracking tool proves that the strength of this method is its independence from prior parameters.

[1]  R. Ho Algebraic Topology , 2022 .

[2]  William J. Godinez,et al.  Objective comparison of particle tracking methods , 2014, Nature Methods.

[3]  Nikolaos Papanikolopoulos,et al.  3D region segmentation using topological persistence , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Manjunath V. Joshi,et al.  Single‐frame image super‐resolution using learned wavelet coefficients , 2004, Int. J. Imaging Syst. Technol..

[5]  Zulaikha Kadim,et al.  Extraction of Moving Objects Using Frame Differencing, Ghost and Shadow Removal , 2014, 2014 5th International Conference on Intelligent Systems, Modelling and Simulation.

[6]  Dmitriy Morozov,et al.  Dualities in persistent (co)homology , 2011, ArXiv.

[7]  Meng Liu,et al.  A review of Traffic Visual Tracking technology , 2008, 2008 International Conference on Audio, Language and Image Processing.

[8]  P. Giblin Graphs, surfaces, and homology , 1977 .

[9]  Chao Chen,et al.  Efficient Computation of Persistent Homology for Cubical Data , 2012 .

[10]  Frédo Durand,et al.  A Topological Approach to Hierarchical Segmentation using Mean Shift , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Michael Robinson Analyzing wireless communication network vulnerability with homological invariants , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[12]  Afra Zomorodian,et al.  Computing Persistent Homology , 2005, Discret. Comput. Geom..

[13]  Valeriu Vrabie,et al.  Persistent homology for object segmentation in multidimensional grayscale images , 2018, Pattern Recognit. Lett..

[14]  Hongdong Li,et al.  Robust Visual Tracking with Deep Convolutional Neural Network Based Object Proposals on PETS , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  P. Koumoutsakos,et al.  Feature point tracking and trajectory analysis for video imaging in cell biology. , 2005, Journal of structural biology.

[16]  Adrien Chan-Hon-Tong,et al.  Tracking based sparse box proposal for time constraint detection in video stream , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[17]  Lei Yang,et al.  Frogeye: Perception of the slightest tag motion , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[18]  Tucker R. Balch,et al.  The multi‐iterative closest point tracker: An online algorithm for tracking multiple interacting targets , 2012, J. Field Robotics.

[19]  Ahmad Mahmoudi Aznaveh,et al.  Iterative Copy-Move Forgery Detection Based on a New Interest Point Detector , 2016, IEEE Transactions on Information Forensics and Security.

[20]  Xue‐Dong Liu,et al.  Supervised‐learning‐based algorithm for color image compression , 2020, ETRI Journal.

[21]  Ulrich Bauer,et al.  Phat - Persistent Homology Algorithms Toolbox , 2014, J. Symb. Comput..

[22]  Gunnar E. Carlsson,et al.  Topological pattern recognition for point cloud data* , 2014, Acta Numerica.

[23]  K. S. Venkatesh,et al.  SURF-based human tracking algorithm for a human-following mobile robot , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[24]  Sidney S. Fels,et al.  Evaluation of Background Subtraction Algorithms with Post-Processing , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[25]  Florian Baumann,et al.  MedianStruck for long-term tracking applications , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[26]  David B. A. Epstein,et al.  Persistent Homology for Fast Tumor Segmentation in Whole Slide Histology Images , 2016, MIUA.

[27]  Ho-Jin Choi,et al.  A four-frames differencing technique for moving objects detection in wide area surveillance , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[28]  David Cohen-Steiner,et al.  Stability of Persistence Diagrams , 2007, Discret. Comput. Geom..

[29]  Petra Perner Tracking Living Cells in Microscopic Images and Description of the Kinetics of the Cells , 2015, KES.

[30]  B. Wattellier,et al.  Quadriwave lateral shearing interferometry for quantitative phase microscopy of living cells. , 2009, Optics express.

[31]  Johannes Schindelin,et al.  TrackMate: An open and extensible platform for single-particle tracking. , 2017, Methods.

[32]  R. Ghrist Barcodes: The persistent topology of data , 2007 .

[33]  Bayram Akdemir,et al.  Cell‐type based semantic segmentation of histopathological images using deep convolutional neural networks , 2019, Int. J. Imaging Syst. Technol..

[34]  Danica Kragic,et al.  Topological trajectory clustering with relative persistent homology , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Steven Verstockt,et al.  Automatic detection, tracking and counting of birds in marine video content , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[36]  Dmitriy Morozov,et al.  Persistent Cohomology and Circular Coordinates , 2011, Discret. Comput. Geom..

[37]  ZhenZhou Wang,et al.  Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000 , 2019 .

[38]  Sebastian Thrun,et al.  Tracking-based semi-supervised learning , 2011, Int. J. Robotics Res..

[39]  Herbert Edelsbrunner,et al.  Computational Topology - an Introduction , 2009 .