Distributed Asynchronous Union-Find for Scalable Feature Tracking

Feature tracking and the visualizations of the resulting trajectories make it possible to derive insights from scientific data and thus reduce the amount of data to be stored. However, existing serial methods are not scalable enough to handle fast increasing data size. In this paper, we tackle the problem of distributed parallelism for feature tracking and visualization by introducing a scalable, asynchronous union-find algorithm. We show that asynchronous communication can improve the scalability of distributed union-find operation in comparison to synchronous communication, as seen in existing methods. In the proposed feature tracking pipeline, we first construct and partition a high-dimensional mesh that incorporates both space and time. Then, the trajectories of features are built distributively across parallel processes, and trajectory pieces are merged asynchronously by using our distributed union-find implementation. Results demonstrate the scalability of tracking critical points on exploding wire experimental data and tracking super level sets on BOUT++ fusion plasma simulations.

[1]  Scott Klasky,et al.  Towards Real-Time Detection and Tracking of Spatio-Temporal Features: Blob-Filaments in Fusion Plasma , 2015, IEEE Transactions on Big Data.

[2]  Kelly P. Gaither,et al.  A Distributed-Memory Algorithm for Connected Components Labeling of Simulation Data , 2015, Topological and Statistical Methods for Complex Data, Tackling Large-Scale, High-Dimensional, and Multivariate Data Spaces.

[3]  Zhehui Wang,et al.  Four-dimensional (4D) tracking of high-temperature microparticles. , 2016, The Review of scientific instruments.

[4]  Kelly P. Gaither,et al.  Visual Analytics for Finding Critical Structures in Massive Time-Varying Turbulent-Flow Simulations , 2012, IEEE Computer Graphics and Applications.

[5]  D. Russell,et al.  Blob dynamics in 3D BOUT simulations of tokamak edge turbulence. , 2004, Physical review letters.

[6]  Qingming Huang,et al.  Hedged Deep Tracking , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Valerio Pascucci,et al.  In-Situ Feature Extraction of Large Scale Combustion Simulations Using Segmented Merge Trees , 2014, SC14: International Conference for High Performance Computing, Networking, Storage and Analysis.

[8]  P. B. Snyder,et al.  BOUT++: A framework for parallel plasma fluid simulations , 2008, Comput. Phys. Commun..

[9]  Tong Liu,et al.  Understanding and Modeling Lossy Compression Schemes on HPC Scientific Data , 2018, 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[10]  Fabio Riva,et al.  Blob properties in full-turbulence simulations of the TCV scrape-off layer , 2017 .

[11]  Xiao Zhao,et al.  The connected-component labeling problem: A review of state-of-the-art algorithms , 2017, Pattern Recognit..

[12]  Kesheng Wu,et al.  Optimizing two-pass connected-component labeling algorithms , 2009, Pattern Analysis and Applications.

[13]  Deborah Silver,et al.  Visualization of multivariate dark matter halos in cosmology simulations , 2013, 2013 IEEE Symposium on Large-Scale Data Analysis and Visualization (LDAV).

[14]  Ronald H. Cohen,et al.  Low-to-high confinement transition simulations in divertor geometry , 2000 .

[15]  Tarek Sayed,et al.  A feature-based tracking algorithm for vehicles in intersections , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[16]  Hanqi Guo,et al.  Tracking vortices in superconductors: Extracting singularities from a discretized complex scalar field evolving in time. , 2016, Physical review. E.

[17]  Zvi Galil,et al.  Data structures and algorithms for disjoint set union problems , 1991, CSUR.

[18]  Julio Martín-Herrero,et al.  Hybrid object labelling in digital images , 2007, Machine Vision and Applications.

[19]  Valerio Pascucci,et al.  Loop surgery for volumetric meshes: Reeb graphs reduced to contour trees , 2009, IEEE Transactions on Visualization and Computer Graphics.

[20]  Kesheng Wu,et al.  Fast connected-component labeling , 2009, Pattern Recognit..

[21]  Dmitriy Morozov,et al.  Efficient Delaunay Tessellation through K-D Tree Decomposition , 2016, SC16: International Conference for High Performance Computing, Networking, Storage and Analysis.

[22]  Sergei Krasheninnikov,et al.  On scrape off layer plasma transport , 2001 .

[23]  Md. Mostofa Ali Patwary,et al.  A Scalable Parallel Union-Find Algorithm for Distributed Memory Computers , 2009, PPAM.

[24]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[25]  Houjun Tang,et al.  Parallel In Situ Detection of Connected Components in Adaptive Mesh Refinement Data , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[26]  Xiaobo Zhou,et al.  TRACKING OF MIGRATING GLIOMA CELLS IN FEATURE SPACE , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[27]  Pavel Tvrdík,et al.  A Parallel Algorithm for Connected Components on Distributed Memory Machines , 2001, PVM/MPI.

[28]  George Cybenko,et al.  Practical parallel Union-Find algorithms for transitive closure and clustering , 1989, International Journal of Parallel Programming.

[29]  G. Ciraolo,et al.  3D structure and dynamics of filaments in turbulence simulations of WEST diverted plasmas , 2019, Nuclear Fusion.

[30]  Hans-Peter Seidel,et al.  Feature Flow Fields , 2003, VisSym.

[31]  Jong-Seung Park,et al.  Stable 2D Feature Tracking for Long Video Sequences , 2008 .

[32]  V. Vaidehi,et al.  Object detection and tracking using statistical and stochastic techniques , 2015, 2015 International Conference on Industrial Instrumentation and Control (ICIC).

[33]  Hanqi Guo,et al.  In situ magnetic flux vortex visualization in time-dependent Ginzburg-Landau superconductor simulations , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[34]  Craig J. Hartley,et al.  A novel feature-tracking echocardiographic method for the quantitation of regional myocardial function: validation in an animal model of ischemia-reperfusion. , 2008, Journal of the American College of Cardiology.