A Tracklet-before-Clustering Initialization Strategy Based on Hierarchical KLT Tracklet Association for Coherent Motion Filtering Enhancement

Coherent motions depict the individuals’ collective movements in widely existing moving crowds in physical, biological, and other systems. In recent years, similarity-based clustering algorithms, particularly the Coherent Filtering (CF) clustering approach, have accomplished wide-scale popularity and acceptance in the field of coherent motion detection. In this work, a tracklet-before-clustering initialization strategy is introduced to enhance coherent motion detection. Moreover, a Hierarchical Tracklet Association (HTA) algorithm is proposed to address the disconnected KLT tracklets problem of the input motion feature, thereby making proper trajectories repair to optimize the CF performance of the moving crowd clustering. The experimental results showed that the proposed method is effective and capable of extracting significant motion patterns taken from crowd scenes. Quantitative evaluation methods, such as Purity, Normalized Mutual Information Index (NMI), Rand Index (RI), and F-measure (Fm), were conducted on real-world data using a huge number of video clips. This work has established a key, initial step toward achieving rich pattern recognition.

[1]  Cuihua Li,et al.  Crowd Density Level Estimation and Anomaly Detection Using Multicolumn Multistage Bilinear Convolution Attention Network (MCMS-BCNN-Attention) , 2022, Applied Sciences.

[2]  Haider K. Hoomod,et al.  Review on Deep Learning Approaches for Anomaly Event Detection in Video Surveillance , 2022, Electronics.

[3]  Jie Li,et al.  Cattle Number Estimation on Smart Pasture Based on Multi-Scale Information Fusion , 2022, Mathematics.

[4]  Ge Yang,et al.  Survey on algorithms of people counting in dense crowd and crowd density estimation , 2022, Multimedia Tools and Applications.

[5]  Abdullah Gani,et al.  Human Activity Recognition: Review, Taxonomy and Open Challenges , 2022, Sensors.

[6]  Waleed Albattah,et al.  Taxonomy of Anomaly Detection Techniques in Crowd Scenes , 2022, Sensors.

[7]  Md Roman Bhuiyan,et al.  Video analytics using deep learning for crowd analysis: a review , 2022, Multimedia Tools and Applications.

[8]  A. K. Karunakar,et al.  Motion pattern-based crowd scene classification using histogram of angular deviations of trajectories , 2022, The Visual Computer.

[9]  Mohamed Fathi Al-Sa'D,et al.  A Social Distance Estimation and Crowd Monitoring System for Surveillance Cameras , 2022, Sensors.

[10]  R. Purwar,et al.  Crowd Abnormality Detection Using Optical Flow and GLCM-Based Texture Features , 2022, J. Inf. Technol. Res..

[11]  Yaowei Wang,et al.  A survey of crowd counting and density estimation based on convolutional neural network , 2021, Neurocomputing.

[12]  Vijaypal Singh Dhaka,et al.  Video based human crowd analysis using machine learning: a survey , 2021, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[13]  K. Yow,et al.  Abnormal Event Detection and Localization via Adversarial Event Prediction , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Xiao Wang,et al.  Pedestrian Attribute Recognition: A Survey , 2019, Pattern Recognit..

[15]  Proceedings of the 11th International Conference on Robotics, Vision, Signal Processing and Power Applications - Enhancing Research and Innovation through the Fourth Industrial Revolution, RoViSP 2021, Penang, Malaysia, 5-6 April 2021 , 2022, RoViSP.

[16]  Xinxin Wei,et al.  Uncertainty quantification and propagation of crowd behaviour effects on pedestrian-induced vibrations of footbridges , 2022, Mechanical Systems and Signal Processing.

[17]  Chee Seng Chan,et al.  Collectiveness analysis with visual attributes , 2021, Neurocomputing.

[18]  Germain Forestier,et al.  Recent trends in crowd analysis: A review , 2021 .

[19]  Raúl Martín-Santamaría ,et al.  An Efficient Algorithm for Crowd Logistics Optimization , 2021, Mathematics.

[20]  Mohamed S. Shehata,et al.  Deep Learning-Based Crowd Scene Analysis Survey , 2020, J. Imaging.

[21]  Khalil Khan,et al.  Advances and Trends in Real Time Visual Crowd Analysis , 2020, Sensors.

[22]  Qi Wang,et al.  Quantifying and Detecting Collective Motion in Crowd Scenes , 2020, IEEE Transactions on Image Processing.

[23]  Feiping Nie,et al.  Detecting Coherent Groups in Crowd Scenes by Multiview Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  George T. Cantwell,et al.  Improved mutual information measure for classification and community detection , 2019, ArXiv.

[25]  A. K. Karunakar,et al.  Scene-Independent Motion Pattern Segmentation in Crowded Video Scenes Using Spatio-Angular Density-Based Clustering , 2020, IEEE Access.

[26]  Donna K. Harman,et al.  Information Retrieval: The Early Years , 2019, Found. Trends Inf. Retr..

[27]  Zhiwen Liu,et al.  Adaptive Crowd Segmentation Based on Coherent Motion Detection , 2017, Journal of Signal Processing Systems.

[28]  Vishal M. Patel,et al.  A Survey of Recent Advances in CNN-based Single Image Crowd Counting and Density Estimation , 2017, Pattern Recognit. Lett..

[29]  Wenhan Luo,et al.  Instant coherent group motion filtering by group motion representations , 2017, Neurocomputing.

[30]  Tarald O. Kvålseth,et al.  On Normalized Mutual Information: Measure Derivations and Properties , 2017, Entropy.

[31]  Xuelong Li,et al.  Patch-based topic model for group detection , 2017, Science China Information Sciences.

[32]  F. Dikbaş A novel two‐dimensional correlation coefficient for assessing associations in time series data , 2017 .

[33]  Xiaogang Wang,et al.  Learning Scene-Independent Group Descriptors for Crowd Understanding , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  He Huang,et al.  Abnormal event detection in crowded scenes using two sparse dictionaries with saliency , 2017, J. Electronic Imaging.

[35]  Quoc Cuong Pham,et al.  Crowd Behavior Analysis Using Local Mid-Level Visual Descriptors , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Xiaogang Wang,et al.  Crowded Scene Understanding by Deeply Learned Volumetric Slices , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Jing Wang,et al.  Spatio-temporal texture modelling for real-time crowd anomaly detection , 2016, Comput. Vis. Image Underst..

[38]  Hongxun Yao,et al.  Unsupervised discovery of crowd activities by saliency-based clustering , 2016, Neurocomputing.

[39]  Haidi Ibrahim,et al.  Recent survey on crowd density estimation and counting for visual surveillance , 2015, Eng. Appl. Artif. Intell..

[40]  Bingbing Ni,et al.  Crowded Scene Analysis: A Survey , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Xiaogang Wang,et al.  Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents , 2014, International Journal of Computer Vision.

[42]  Emanuele Della Valle,et al.  Web Information Retrieval , 2013, Data-Centric Systems and Applications.

[43]  Hau-San Wong,et al.  Crowd Motion Partitioning in a Scattered Motion Field , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[44]  Mubarak Shah,et al.  Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Chabane Djeraba,et al.  Motion Pattern Extraction and Event Detection for Automatic Visual Surveillance , 2011, EURASIP J. Image Video Process..

[46]  A. G. Asuero,et al.  The Correlation Coefficient: An Overview , 2006 .

[47]  George Karypis,et al.  Empirical and Theoretical Comparisons of Selected Criterion Functions for Document Clustering , 2004, Machine Learning.

[48]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[49]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[50]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[51]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .