An adaptive block-based matching algorithm for crowd motion sequences

For crowd analytics and surveillance systems, motion estimation is an essential first step. Lots of crowd motion estimation algorithms have been presented in the last years comprising pedestrian motion. However, algorithms based on optical flow and background subtraction have numerous limitations such as the complexity of the computation in the presence of high dense crowd and sudden motion changes. Therefore, a novel estimation algorithm is proposed to measure the motion of crowd with less computational complexity and satisfy the real time requirements. The proposed algorithm is based on block-based matching, particle advection, and social force model. By the block-based matching, the motion is estimated in each frame, and the corresponding motion field is created. The particle advection process provides more information about the behavior of pedestrians groups, their tracked trajectories and the boundary of each group segment. Relying on the social force model, a predicted direction of the motion vectors (MV) could be measured significantly. Subsequently, the block-based technique is combined with the social force model to obtain the accurate motion vector with the less possible number of search points. The experimental results indicate that the proposed method achieves high performance by reducing the search points, particularly when many collision situations or obstacles exist in the scenes. Considering the reduction in the computational complexity, the quality of degradation is very low. In all cases, average PSNR degradation of the proposed algorithm is only 0.09.

[1]  Lili Lin,et al.  Fast predictive motion estimation algorithm with adaptive search mode based on motion type classification , 2014, Signal, Image and Video Processing.

[2]  James Nga-Kwok Liu,et al.  Gait flow image: A silhouette-based gait representation for human identification , 2011, Pattern Recognit..

[3]  Alexis M. Tourapis,et al.  Enhanced predictive zonal search for single and multiple frame motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[4]  Larry S. Davis,et al.  Motion-based recognition of people in EigenGait space , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[5]  Xiaohua Yang,et al.  A fast motion estimation algorithm based on adaptive pattern and search priority , 2014, Multimedia Tools and Applications.

[6]  N. S. Love,et al.  An Empirical Study of Block Matching Techniques for the Detection of Moving Objects , 2006 .

[7]  Shih-Yu Huang,et al.  Adaptive fast block-matching algorithm by switching search patterns for sequences with wide-range motion content , 2005, IEEE Trans. Circuits Syst. Video Technol..

[8]  J. Ferryman,et al.  An overview of the PETS 2009 challenge , 2009 .

[9]  David Zhang,et al.  Human gait recognition by the fusion of motion and static spatio-temporal templates , 2007, Pattern Recognit..

[10]  Tian-Sheuan Chang,et al.  Fast Motion Estimation Algorithm and Design for Real Time QFHD High Efficiency Video Coding , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Imran N. Junejo,et al.  Crowd modeling using social networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[12]  Lap-Pui Chau,et al.  Hexagon-based search pattern for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[13]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[14]  Yi Yang,et al.  Semantic Pooling for Complex Event Analysis in Untrimmed Videos , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[16]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[17]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[18]  Jiang Li,et al.  An effective variable block-size early termination algorithm for H.264 video coding , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Anand Paul,et al.  Adaptive Search Window for High Efficiency Video Coding , 2015, J. Signal Process. Syst..

[20]  Iain E. G. Richardson,et al.  The H.264 Advanced Video Compression Standard , 2010 .

[21]  Serge P. Hoogendoorn,et al.  State-of-the-art crowd motion simulation models , 2013 .

[22]  Wentong Cai,et al.  A case study of multi-resolution modeling for crowd simulation , 2009, SpringSim '09.

[23]  Kai-Kuang Ma,et al.  Correction to "a new diamond search algorithm for fast block-matching motion estimation" , 2000, IEEE Trans. Image Process..

[24]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Feiping Nie,et al.  Compound Rank- $k$ Projections for Bilinear Analysis , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Jar-Ferr Yang,et al.  Computation reduction for motion search in low rate video coders , 2002, IEEE Trans. Circuits Syst. Video Technol..

[27]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[28]  Yassine Ruichek,et al.  A Video-Analysis-Based Railway–Road Safety System for Detecting Hazard Situations at Level Crossings , 2015, IEEE Transactions on Intelligent Transportation Systems.

[29]  Adrien Treuille,et al.  Continuum crowds , 2006, SIGGRAPH 2006.

[30]  Mubarak Shah,et al.  Abnormal crowd behavior detection using social force model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Aamir Saeed Malik,et al.  Motion estimation of crowd flow using optical flow techniques: A review , 2015, 2015 9th International Conference on Signal Processing and Communication Systems (ICSPCS).

[32]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[33]  Wei Li,et al.  A fast block-matching algorithm using smooth motion vector field adaptive search technique , 2008, Journal of Computer Science and Technology.

[34]  Tao Chen,et al.  Object-Level Motion Detection From Moving Cameras , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Weimin Li,et al.  Social recommendation based on trust and influence in SNS environments , 2017, Multimedia Tools and Applications.

[36]  Shuzhi Sam Ge,et al.  Real-time one-dimensional motion estimation and its application in computer vision , 2015, Machine Vision and Applications.

[37]  A. Schadschneider Cellular Automaton Approach to Pedestrian Dynamics - Theory , 2001, cond-mat/0112117.

[38]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[39]  Patrick Bouthemy,et al.  Recovery of motion patterns and dominant paths in videos of crowded scenes , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[40]  Ahmet M. Kondoz,et al.  Adaptive direction search algorithms based on motion correlation for block motion estimation , 2011, IEEE Transactions on Consumer Electronics.

[41]  Jie Hou,et al.  A self-adaptive optical flow method for the moving object detection in the video sequences , 2014 .

[42]  Patrick Bouthemy,et al.  Simultaneous Motion Detection and Background Reconstruction with a Mixed-State Conditional Markov Random Field , 2008, ECCV.

[43]  Lurng-Kuo Liu,et al.  A block-based gradient descent search algorithm for block motion estimation in video coding , 1996, IEEE Trans. Circuits Syst. Video Technol..