Behavior Tracking in Video Surveillance Applications: A Detailed Study

The problem of video surveillance toward behavior tracking has been well studied. The object tracking in video surveillance and behavior analysis has been used for different problems. Numerous techniques have been presented earlier for the tracking of objects and classification of behaviors. The general approaches use a background model to identify the foreground objects. Based on the foreground objects identified, the object tracking has been performed. Similarly, various approaches consider different features to perform object detection and classification. Each method produces a different result with varying accuracy in behavior tracking. This paper analyses various methods of object tracking and behavior analysis in video surveillance. A detailed survey on the methods of object tracking is performed, and a comparative study is presented in this paper.

[1]  D. Pokrajac,et al.  Spatial-temporal algorithm for moving objects detection in infrared video sequences , 2005, TELSIKS 2005 - 2005 uth International Conference on Telecommunication in ModernSatellite, Cable and Broadcasting Services.

[2]  Shafaatunnur Hasan,et al.  Student behavior analysis using self-organizing map clustering technique , 2015 .

[3]  Gang Wang,et al.  Video Tracking Using Learned Hierarchical Features , 2015, IEEE Transactions on Image Processing.

[4]  Giuseppe Manfredi,et al.  An algorithm for the recognition of levels of congestion in road traffic problems , 2009, Math. Comput. Simul..

[5]  A NiranjilKumar,et al.  Background Subtraction in Dynamic Environment based on Modified Adaptive GMM with TTD for Moving Object Detection , 2015 .

[6]  Martial Hebert,et al.  Spatio-temporal Shape and Flow Correlation for Action Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Naokazu Yokoya,et al.  Real-Time Tracking of Multiple Moving Object Contours in a Moving Camera Image Sequence , 2000 .

[9]  Sungyoung Lee,et al.  Traffic Behavior Recognition Using the Pachinko Allocation Model , 2015, Sensors.

[10]  Kian-Ming Lim,et al.  Self-taught learning of a deep invariant representation for visual tracking via temporal slowness principle , 2015, Pattern Recognit..

[11]  Seong-Won Lee,et al.  Combined shape and feature-based video analysis and its application to non-rigid object tracking , 2011 .

[12]  S AnupamaH.,et al.  Human Action Recognition using Image Processing and Artificial Neural Networks , 2013 .

[13]  Anupam Agrawal,et al.  A survey on activity recognition and behavior understanding in video surveillance , 2012, The Visual Computer.

[14]  Paulo Lobato Correia,et al.  Automatic Detection and Classification of Traffic Signs , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[15]  Young Hoon Joo,et al.  Fast and robust algorithm of tracking multiple moving objects for intelligent video surveillance systems , 2011, IEEE Transactions on Consumer Electronics.

[16]  Nahum Kiryati,et al.  Real-time abnormal motion detection in surveillance video , 2008, 2008 19th International Conference on Pattern Recognition.

[17]  Varsha Hemant Patil,et al.  A Study of Vision based Human Motion Recognition and Analysis , 2016, Int. J. Ambient Comput. Intell..

[18]  M. Omair Ahmad,et al.  Online multi-object tracking via robust collaborative model and sample selection , 2017 .

[19]  Junji Yamato.  Recognizing Human Behavior Using Hidden Markov Models , 2002 .

[20]  Yuan F. Zheng,et al.  Object Tracking in Structured Environments for Video Surveillance Applications , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  R. H. Havaldar,et al.  Human detection and tracking in video surveillance system , 2016, 2016 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC).

[22]  Ba-Ngu Vo,et al.  A labeled random finite set online multi-object tracker for video data , 2019, Pattern Recognit..

[23]  Wei Zhang,et al.  Moving vehicles segmentation based on Bayesian framework for Gaussian motion model , 2006, Pattern Recognit. Lett..

[24]  Jake K. Aggarwal,et al.  Detection of object abandonment using temporal logic , 2009, Machine Vision and Applications.

[25]  Xiaobo Li,et al.  Detection of vehicles from traffic scenes using fuzzy integrals , 2002, Pattern Recognit..

[26]  Chaiwat Nuthong,et al.  Front Moving Vehicle Detection and Tracking with Kalman Filter , 2019, 2019 IEEE 4th International Conference on Computer and Communication Systems (ICCCS).

[27]  Mohand Saïd Allili.  Effective object tracking by matching object and background models using active contours , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[28]  Andrey V. Savkin,et al.  A framework for safe assisted navigation of semi-autonomous vehicles among moving and steady obstacles , 2017, Robotica.

[29]  Ayman Alfalou,et al.  Fuzzy logic and optical correlation-based face recognition method for patient monitoring application in home video surveillance , 2011 .

[30]  Hocine Chebi,et al.  Strategy of detecting abnormal behaviors by fuzzy logic , 2017, 2017 Intelligent Systems and Computer Vision (ISCV).

[31]  Peter H. N. de With,et al.  Flexible Human Behavior Analysis Framework for Video Surveillance Applications , 2010, Int. J. Digit. Multim. Broadcast..

[32]  Dmitry O. Gorodnichy,et al.  Adaptive skew-sensitive ensembles for face recognition in video surveillance , 2015, Pattern Recognit..

[33]  Radha Poovendran,et al.  Group Event Detection With a Varying Number of Group Members for Video Surveillance , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  David Zhang,et al.  Moving Vehicle Detection for Automatic Traffic Monitoring , 2007, IEEE Transactions on Vehicular Technology.

[35]  Jun-Wei Hsieh,et al.  Video-Based Human Movement Analysis and Its Application to Surveillance Systems , 2008, IEEE Transactions on Multimedia.

[36]  Sung Wook Baik,et al.  Convolutional Neural Networks Based Fire Detection in Surveillance Videos , 2018, IEEE Access.

[37]  Chao Deng,et al.  Multiobject Tracking in Videos Based on LSTM and Deep Reinforcement Learning , 2018, Complex..

[38]  Tao Zhang,et al.  A Novel Method on Moving-Objects Detection Based on Background Subtraction and Three Frames Differencing , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[39]  Nicolai Petkov,et al.  Learning skeleton representations for human action recognition , 2019, Pattern Recognition Letters.

[40]  Shunsuke Kamijo,et al.  Behavior understanding at railway station by association of locational semantics and postures , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[41]  S. Murali,et al.  Segmentation of Motion Objects from Surveillance Video Sequences Using Temporal Differencing Combined with Multiple Correlation , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[42]  Mahesh M. Bundele,et al.  Research on Intelligent Video Surveillance techniques for suspicious activity detection critical review , 2016, 2016 International Conference on Recent Advances and Innovations in Engineering (ICRAIE).

[43]  Alan Wee-Chung Liew,et al.  Multi-label classification via label correlation and first order feature dependance in a data stream , 2019, Pattern Recognit..

[44]  Yang Zhang,et al.  Ship detection for visual maritime surveillance from non-stationary platforms☆ , 2017 .

[45]  Francisco Javier Ferrández Pastor,et al.  A Vision-Based System for Intelligent Monitoring: Human Behaviour Analysis and Privacy by Context , 2014, Sensors.

[46]  Hui Liu,et al.  Aquatic Toxic Analysis by Monitoring Fish Behavior Using Computer Vision: A Recent Progress , 2018, Journal of toxicology.

[47]  Chee Seng Chan,et al.  iSurveillance: Intelligent framework for multiple events detection in surveillance videos , 2014, Expert Syst. Appl..

[48]  Dimitri Voilmy,et al.  A new paradigm for autonomous human motion description and evaluation: Application to the Get Up & Go test use case , 2018, Pattern Recognit. Lett..

[49]  Bo Yu.  Design and Implementation of Behavior Recognition System Based on Convolutional Neural Network , 2017 .

[50]  Jing Tian,et al.  Dust particle detection in traffic surveillance video using motion singularity analysis , 2016, Digit. Signal Process..

[51]  Xutong Niu,et al.  A semi-automatic framework for highway extraction and vehicle detection based on a geometric deformable model , 2006 .

[52]  Ayesha Gurnani,et al.  Human Detection and Tracking for Video Surveillance: A Cognitive Science Approach , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[53]  Tom Hintz,et al.  Neural network classifiers for automated video surveillance , 2003, 2003 IEEE XIII Workshop on Neural Networks for Signal Processing (IEEE Cat. No.03TH8718).

[54]  Li Li,et al.  Movement Human Actions Recognition Based on Machine Learning , 2018, Int. J. Online Eng..

[55]  Tieniu Tan,et al.  Human Behavior Analysis Based on a New Motion Descriptor , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[56]  Yingjie Yang,et al.  A Retrieval Optimized Surveillance Video Storage System for Campus Application Scenarios , 2018, J. Electr. Comput. Eng..

[57]  Yihong Gong,et al.  Human Tracking Using Convolutional Neural Networks , 2010, IEEE Transactions on Neural Networks.

[58]  Sofiane Boucenna,et al.  Quantifying patterns of joint attention during human-robot interactions: An application for autism spectrum disorder assessment , 2019, Pattern Recognit. Lett..

[59]  Jiwen Lu,et al.  Deep Metric Learning for Visual Tracking , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[60]  K. Porkumaran,et al.  Background Subtraction Techniques for Human body segmentation in Indoor video surveillance , 2014 .

[61]  Ersin Bayram,et al.  Supervised Self-Organizing Maps in Drug Discovery. 1. Robust Behavior with Overdetermined Data Sets , 2005, J. Chem. Inf. Model..

[62]  Pritee Khanna,et al.  Depth matrix and adaptive Bayes classifier based dynamic hand gesture recognition , 2019, Pattern Recognit. Lett..

[63]  Yonghuai Liu,et al.  DFP-ALC: Automatic video summarization using Distinct Frame Patch index and Appearance based Linear Clustering , 2019, Pattern Recognit. Lett..

[64]  K Seemanthini,et al.  Human Detection and Tracking using HOG for Action Recognition , 2018 .

[65]  Adam Herout,et al.  Video-Based Bicycle Detection in Underground Scenarios , 2009 .

[66]  Juan M. Corchado,et al.  Detection of Cattle Using Drones and Convolutional Neural Networks , 2018, Sensors.

[67]  François Brémond,et al.  Real-time control of video surveillance systems with program supervision techniques , 2006, Machine Vision and Applications.

[68]  Antonio Fernández-Caballero,et al.  A fuzzy model for human fall detection in infrared video , 2013, J. Intell. Fuzzy Syst..

[69]  Tomasz Kryjak,et al.  Real-time implementation of foreground object detection from a moving camera using the ViBe algorithm , 2014, Comput. Sci. Inf. Syst..

[70]  M. Ali Akber Dewan,et al.  Background Independent Moving Object Segmentation for Video Surveillance , 2009, IEICE Trans. Commun..

[71]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.