A numerical approach for tracking unknown number of individual targets in videos

Suppose that we wish to get a comprehensive match of a target in the next frame. Where would we search the target in the next frame? Brute-force search has an asymptotic runtime of O ( n ! ) with problem size n. Yet we can search the target only from a number of automatically generated specific regions, named candidate regions, in the next frame. But how can we get those regions? Deeming the silhouettes of movers, this paper denotes a detailed deliberation of how to generate those candidate regions automatically and then how to track unknown number of individual targets with them. Phase-correlation technique aids to find the key befitting matches of the targets using them. Hungarian method in combination with a state estimation process called Kalman filter finds the best correspondence of the targets among those matches, allowing us to construct full trajectories of unknown number of individual targets in 3D space irresistibly swift as compared to brute-force search since the relative runtime reduced from O ( n ! ) to O ( n 3 ) . Favorable outcomes, upon conducting experiments on videos from three different datasets, show the robustness and effectiveness of our approach. Brute-force search with O ( n ! ) can be used to get a comprehensive match of a target.Due to combinatorial explosion effect the usage of brute-force search is impractical.But we do not need to search a target all of its possible regions in the next frame.We can search it only some automatically generated regions, named candidate regions.With candidate regions full trajectories of targets can be obtained in O ( n 3 ) .

[1]  J. Munkres ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[2]  Gérard G. Medioni,et al.  Tracking Using Motion Patterns for Very Crowded Scenes , 2012, ECCV.

[3]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Tobias Bjerregaard,et al.  A survey of research and practices of Network-on-chip , 2006, CSUR.

[5]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[6]  Ramakant Nevatia,et al.  Multiple Target Tracking by Learning-Based Hierarchical Association of Detection Responses , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[8]  Xiaobo Zhou,et al.  Red Blood Cell Tracking Using Optical Flow Methods , 2014, IEEE Journal of Biomedical and Health Informatics.

[9]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Gang Xiao,et al.  Fish group tracking based on Delaunay Triangulation network , 2011, 2011 4th International Congress on Image and Signal Processing.

[11]  Robert T. Collins,et al.  Vision-Based Analysis of Small Groups in Pedestrian Crowds , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jinlong Yang,et al.  Adaptive Gaussian mixture probability hypothesis density for tracking multiple targets , 2016 .

[13]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Yi Yang,et al.  Layered Object Models for Image Segmentation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Bir Bhanu,et al.  Tracking pedestrians with bacterial foraging optimization swarms , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[16]  Md. Haidar Sharif High-Performance Mathematical Functions for Single-Core Architectures , 2014, J. Circuits Syst. Comput..

[17]  Guillermo Sapiro,et al.  Morphing Active Contours , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Youfu Li,et al.  Learning Local Appearances With Sparse Representation for Robust and Fast Visual Tracking , 2015, IEEE Transactions on Cybernetics.

[19]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[20]  Alain Trubuil,et al.  Spatio-temporal Interaction of Bacteria Mixture within Biofilms , 2015 .

[21]  Amit K. Roy-Chowdhury,et al.  Tracking multiple interacting targets in a camera network , 2015, Comput. Vis. Image Underst..

[22]  Changsheng Xu,et al.  Multi-object tracking via MHT with multiple information fusion in surveillance video , 2014, Multimedia Systems.

[23]  Mubarak Shah,et al.  Floor Fields for Tracking in High Density Crowd Scenes , 2008, ECCV.

[24]  Mario Fernando Montenegro Campos,et al.  Particle Filter-Based Predictive Tracking for Robust Fish Counting , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[25]  Takeo Kanade,et al.  Tracking in unstructured crowded scenes , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Guizhong Liu,et al.  Multiple pedestrians tracking algorithm by incorporating histogram of oriented gradient detections , 2013, IET Image Process..

[27]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[28]  Olivier Aycard,et al.  Multiple pedestrian tracking using Viterbi data association , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[29]  Jorge Batista,et al.  Multi-object tracking using an adaptive transition model particle filter with region covariance data association , 2008, 2008 19th International Conference on Pattern Recognition.

[30]  Gérard G. Medioni,et al.  Object reacquisition using invariant appearance model , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[31]  Yang Yi,et al.  A novel hierarchical data association with dynamic viewpoint model for multiple targets tracking , 2016, J. Vis. Commun. Image Represent..

[32]  Guangming Xie,et al.  Real-time tracking of moving objects on a water surface , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[33]  Ko Nishino,et al.  Tracking Pedestrians Using Local Spatio-Temporal Motion Patterns in Extremely Crowded Scenes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Qixiang Ye,et al.  Combined feature evaluation for adaptive visual object tracking , 2011, Comput. Vis. Image Underst..

[35]  Fredrik Gustafsson,et al.  Multi-target tracking with PHD filter using Doppler-only measurements , 2014, Digit. Signal Process..

[36]  Takeshi Saitoh,et al.  Bird tracking and flapping motion recognition for monitoring system , 2009, 2009 ICCAS-SICE.

[37]  Alireza Bab-Hadiashar,et al.  Multi-Bernoulli sensor-selection for multi-target tracking with unknown clutter and detection profiles , 2016, Signal Process..

[38]  Jinyan Li,et al.  Bird Flu Outbreak Prediction via Satellite Tracking , 2014, IEEE Intelligent Systems.

[39]  Min C. Shin,et al.  Ant tracking with occlusion tunnels , 2014, IEEE Winter Conference on Applications of Computer Vision.

[40]  Isaac Cohen,et al.  Object reacquisition using invariant appearance model , 2004, ICPR 2004.

[41]  A. Groves Area of Intersection of an Ellipse and a Rectangle , 1963 .

[42]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[43]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .